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A RECONSIDERATION OF THE PROBLEM OF INTROSPECTION 


DAVID 


University 


It is the purpose of this essay to 
raise a general question for rethinking 
in the perspective of modern times. 
Two related considerations are in- 
volved in the motivation to write and 
publish an essay on introspection as 
a method for the investigation of 
psychological phenomena. The first 
is a sense of society’s need for a psy- 
chology which is more appropriate to 
its problems. The second is a convic- 
tion that although psychologists 
should be methodologically careful, 
they should not afford themselves the 
luxury of methodological snobbery. 
There is no investigatory method 
which is “‘pure,’”’ and which provides 
an absolute guarantee against the 
commission of error. If errors be 
committed, we look to the future for 
their correctives. In the meantime, 
and perhaps ultimately, we accept a 
pragmatic criterion. 

It is characteristic in the history 
of ideas that when some notion is re- 
jected, even for adequate cause, 
many seemingly associated notions 
get rejected with it. Often these 
associated notions may be sound. 
One of the theses of this essay is that 
such has been the case with intro- 
spection. In the outright rejection of 
the method of introspection, much 
that was of considerable value was 
rejected. 

In spite of the avowed rejection of 
the method, it has stayed with us in 


several disguised forms. As Boring 
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of Missouri 


has recently indicated, ‘introspection 
is still with us, doing its business 
under various aliases, of which verbal 
report is one” (4, p. 169). Boring 
relatively uncritical of the 
manner in which we contemporarily 
avail ourselves of introspection. The 
argument here is for a careful and 
avowed use of introspection. 

In less disguised form introspection 
is with us in contemporary clinical 
psychology. The method of intro- 
spection is the method that the pa- 
tient uses, although there is little 
avowed recognition of it as the 
method of the clinician, except per- 
haps among the psychoanalysts (15). 
However, “therapy” is coming to be 
viewed as appropriate training for 
the aspirant clinician even in non- 
psychoanalytic contexts. 


seems 


A Hyporuests CONCERNING THE 
REJECTION OF THE INTROSPECTIVE 
METHOD 


The rejection of the method of in- 
trospection is coincident with the in- 
ception of behaviorism in America. 
The first important behavioristic 
pronunciamento took place in 1913 
(20). It is important to understand 
the immediate antecedents of be- 
haviorism in order to understand the 
wide popularity that it gained. Bor- 
ing’s comprehensive history makes 
it unnecessary to recount the in- 
volved circumstances associated with 
the death of classical introspection. 
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Boring believes that it ‘‘went out of 
style...because it had demon- 
strated no functional use and there- 
fore seemed dull, and also because it 
was unreliable” (4, p. 174). In the 
next few paragraphs a_ hypothesis 
will be offered to supplement that of 
Boring. 

Psychology was in the throes of the 
Wiirzburg-Cornell struggle in the 
first. decade of the twentieth century. 
The Wiirzburgers had discovered 
imageless thoughts; and they them- 
selves hardly knew what to do with 
them. ‘Titchener, at Cornell, sensed 
the staggering implications of the 
Wirzburg findings, and struggled 
desperately to reject them (16). 

The psychological literature of the 
time is in many respects confused, 
repetitive, and—we might say— 
anguished. Psychology had, _ it 
seemed, got itself into absolutely in- 
extricable difficulties; and there was 
no one within the introspective move- 
ment who had the clarity of vision to 
go beyond these difficulties. Watson, 
for all the limitations that we may 
ascribe to him, had clarity and offered 
a program which psychologists could 
follow. 

Let us briefly examine the nature 
of some of the Wiirzburg findings. 
They discovered that thought was 
possible without images; and that 
thought was guided by states vari- 
ously designated by the terms A uf- 
gabe, Bewusstseinslage, and delermini- 
erende Tendenz. Vhe favored method 
was the Ausfragemethode. Mayer and 
Orth (11) used the method of free 
association to a verbal stimulus, in- 
structing the subject to report every- 
thing that went on between the hear- 
ing of the stimulus word and the 
making of the response. Messer (14) 
finds himself forced to posit un- 
conscious processes underlying the 
processes of thought. Ach (1, 9)! in- 
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troduces the concept of the will, i.e., 
motivation, as guiding the thought 
processes; he uses a probing investi- 
gatory procedure; and he uses hyp- 
nosis. Biihler (6) indicates that it is 
important, in the study of the 
thought processes, to empathize and 
sympathize with the subjects en- 
gaged in this kind of experimentation. 
Then, the problem is dropped like 
the proverbial hot potato. Kiilpe, 
the leading figure in the Wiirzburg 
movement, leaves Wiirzburg and goes 
to Bonn in 1909, and the work prac- 
tically ceases. Bihler posthumously 
publishes Kiilpe’s lectures which, ac- 
cording to Boring, ‘‘contain a pretty 
complete system of psychology. But 
the chapter on thought was missing! 
Bihler said that-Kiilpe had not been 
lecturing on the topic’”’ (3, p. 407). 
In the light of the foregoing, and in 
the light of what we have learned 
from psychoanalysis, a rather simple 
explanation suggests itself. These in- 
vestigators were using themselves 
and each other as subjects. They had 
struck the unconscious, and particu- 
larly unconscious motivation, and 
had to probe it if they were to make 
any headway. However, as we know 
today, probing the unconscious tends 
to generate anxiety and resistance; 
and these investigators simply were 
not prepared to undergo the neces- 
sary personal trials involved. Boring 
(4, p. 186) suggests a relationship be- 
tween the Wiirzburg school and 
Freud, but makes little of it. 
Psychology had two possible alter- 
natives: either to widen its investi- 
gations to take account of and to 
study the role of unconscious motiva- 
tion on the thought processes, or to 
detour. Academic psychology de- 
toured; and detoured in two ways: 





‘The writer could not locate a copy of 


Ach’s book. This sentence is based on 
Humphrey's (9) summary of Ach’s work. 
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It detoured by way of behaviorism, 
completely rejecting (at least avow- 
edly) the whole method of intro- 
spection, and it detoured by way 
of gestalt psychology. The former 
dropped the whole concept of mind, 
conscious and unconscious. ‘The 
latter adopted as a basic principle 
that whatever introspection is done 
should be naive introspection, with 
no probing and no analysis, thus 
presenting intrusion upon the uncon- 
scious. 


A Basic DISTINCTION FOR 
INTROSPECTION 


Perhaps one of the most important 
distinctions necessary for the under- 
standing of the nature of introspec- 
tion is the classical one between the 
experience and that of which the ex- 
perience is. It is the distinction which 
is contained in the classical one of 
Kundgabe versus Beschreibung (A). 
It is the distinction which is indicated 
by the concept of stimulus-error (2). 
It is the distinction which the psycho- 
analyst makes when he concerns him- 
self primarily with a memory, as con- 
trasted with the event to which the 
memory presumably refers. 

The distinction is somewhat dif- 
ficult to grasp when we deal with per- 
ception. Let us consider a simple ex- 
perience reported as ‘‘I see a book.” 
From the point of view of this dis- 
tinction it is one or another of two 
reports: “I see a book,” or “I see a 
book.”’ In the first instance it is a re- 
port of experience as experience. In 
the second instance the reference is to 
the object rather than to the experi- 
ence of the object. The first can be 
true, and the second false, as, for ex- 
ample, in an hallucination. 

The distinction is easier to make 
when we consider something like 
anxiety. It is hard to make when the 
experience involves an external stim- 
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ulus. It is of interest that when 
Washburn made her presidential ad- 
dress before the American Psycho- 
logical Association (19) in 1921 she 
felt that it was necessary to say that 
introspection is proper only where 
there is an external stimulus. This, 
she believed, would endow introspec- 
tion with ‘objectivity’ —an unfor- 
tunate semantic identification of 
“object” with “objectivity.” It is 
here, probably, when the Watsonian 
noose was drawing very tight around 
the neck of introspection, that intro- 
spection surrendered the very thing 
which was its major merit.  Intro- 
spection has its maximum value on 
very experiences for which 
there may be no conspicuous physical 
joy, anxiety, 
anger, depression, exhilaration, etc. 


those 


stimuli, such as grief, 


THe PROBLEM OF LANGUAGE 
AND COMMUNICATION 

A major criticism which has been 
leveled against the method of intro- 
spection is that the data of introspec- 
tion are not public. In the case of 
overt behavior it is possible, at least 
in principle, for two observers to ob- 
serve a given phenomenon § simul- 
taneously. This has sometimes been 


referred to as the criterion of pub- 
licity; and it has been said that data 
are not acceptable unless this cri- 


terion has been satisfied (again, at 
least in principle). 

That introspective data are not 
public in this sense is not to be ques- 
What is to be questioned is 

the essential. 
What is the value of the criterion of 
publicity? Its value, presumably, 
the conviction that it 
avoids error and provides for verifica- 
tion. However, can we not have veri- 
fication without publicity? Let us 
consider one of the most acceptable 
kinds of investigatory procedure from 


tioned. 


whether criterion is 


inheres in 
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this point of view, the conditioning 
experiment. There is no way of veri- 
fying Pavlov’s experiments today by 
having another observer watching 
them, since, to say the least, Pavlov’s 
dogs are probably all quite dead. In 
order to verify Pavlov’s findings we 
would have to get other dogs. Fur- 
thermore, the fact that two people 
could have stood by to count the 
number of drops of saliva is quite ir- 
relevant. If the criterion of publicity 
is not met by introspection, it is not 
really very serious as long as each 
scientist has, so to speak, at least one 
““dog’’ whom he can observe directly. 

The crisis which was generated by 
disparate results from Wiirzburg and 
Cornell, with the one finding image- 
less thoughts and the other not find- 
ing them, was hardly adequate reason 
for the total rejection of introspec- 
tion. Disparate results from different 
laboratories are usually provocative 
of further investigation, rather than 
the occasion for dropping the prob- 
lems, the methods, and the funda- 
mental points of view involved. The 
failure of the introspective method to 
satisfy this naive criterion of pub- 
licity could hardly have been the real 
reason for the rejection of introspec- 
tion as a method. 

A more important problem is the 
possibility of publicity, not of the 
data, but of the report. Even though 
the process of introspective observa- 
tion is, in a sense, private, the infor- 
mation gleaned from the observations 
must be public. This raises the ques- 
tion of language and communication. 
There are two questions that may be 
asked in connection with language 
with respect to introspection: First, 
if we relate our introspections to one 
another, would we understand one 
another? Second, if we do understand 
one another, how does this come to 
pass? If the answer to the first ques- 
tion is to any degree affirmative, then 
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to that extent is the criterion of pub- 
licity of report satisfied. 

For the answer to the first question 
we appeal, at the very least, to com- 
mon sense. If we hear a person say, 
“T am sorry,” or ‘“‘I am worried,” or 
“‘T feel sick,” etc., there is hardly any 
question but that we understand 
what he means. There are times 
when we may not believe him; but the 
possibility of fraud, intentional or un- 
intentional, or of lack of precision 
exists with respect to any methodo- 
logy. The fact is, however, that we 
understand him. 

The answer to the second question 
now becomes a matter for empirical 
investigation. This is not the place to 
enter into a detailed discussion of the 
psychology of language learning. 
However, it is extremely pertinent to 
indicate that the theory of language 
learning implicit in contemporary be- 
havioristics is much more simple than 
is consistent with the facts. This im- 
plicit theory may be roughly charac- 
terized as follows: 

The teacher holds up a ball and 
says, “Ball.” The learner repeats, 
“Ball.” The learner then, presuma- 
bly, comes to “know” the meaning of 
the word. Certainly the theory is 
stretched to the breaking point when 
presented with the fact that we all 
fairly well understand the meanings 
of words such as “‘sorrow,”’ ‘‘feeling,”’ 
“nausea,” “‘if,’’ “‘but,’’ ete. 


INTROSPECTION AS RETROSPECTION 


In 1921 Titchener (18) wrote an 
essay which, in part, attempted to 
present to English-speaking readers 
some of the contributions of Franz 
Brentano. In the judgment of the 
writer, Brentano is one of the most 
important figures in the history of 
psychology. The major work of 
Brentano with respect to psychology 
(5), has not, as far as could be deter- 
mined by the writer, been translated 
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into English. Of Brentano and 
Wundt, Titchener wrote: ‘‘The stu- 
dent of psychology, though his per- 
sonal indebtedness be also twofold, 
must still make his choice for one or 
the other. There is no middle way 
between Brentano and Wundt”’ (18, 
p. 108). For the most part, the choice 
of the classical introspectionists was 
for Wundt. Wundt and Brentano 
published their major psychological 
works at about the same time. —Two 
major schools of thought issue from 
Brentano. One is the already- 
mentioned Wiirzburg school. The 
other is psychoanalysis, with Bren- 
tano having been the only academic 
psychologist under whom Freud stud- 
ied (12, 13). Psychoanalysis, how- 
ever, differed from the Wiirzburgers 
with respect to a readiness to face the 
unconscious. It may have been easier 
for Freud to break through to the 
unconscious because it was not his 
own unconscious but the unconscious 
It was only second- 


of his patients. 
arily that Freud used himself as sub- 
ject. The Wiirzburgers, on the other 
hand, used themselves and each other 
as subjects. 

Brentano, Kiilpe, and Freud con- 
ceived of introspection not as of the 


present, but the past. They took 
seriously what was then a common 
observation that introspection at the 
moment an experience is taking place 
changes the character of that experi- 
ence. If we are interested, say, in 
anger, then introspection at the mo- 
ment of anger tends to reduce the 
anger. It is only when anger is past 
that it can be properly examined. 
Using the method of introspection, 
thus avowedly retrospectively, makes 
it possible to examine psychological 
phenomena which cannot readily be 
elicited in the laboratory, except per- 
haps with very great ingenuity. 
This difficulty of the introspection 
of Wundt and Titchener was ade- 
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quately recognized by McDougall. 
He wrote: ‘Experimental introspec- 
tion has obvious limitations. Many of 
our most vital and interesting experi- 
ences, such as grief or joy or fear or 
moral struggle, cannot be induced at 
will, except perhaps, in very slight 
degrees. And, under the most favour- 
able conditions, introspection of our 
more vivid and vital experiences is 
difficult, because we are apt to be 
primarily interested in the events of 
the outer world in which we are 
taking part, if only as observers. 
Then again the very act of introspec- 
tion does to some extent modify the 
experiences we wish to observe and 
describe; so that in introspecting we 
partially defeat our own purposes” 
(10, p. 4). 

Thus, the type of introspection 
which was advocated by Titchener, 
and which was the object of attack 
by the anti-introspectionists, was a 
type which, by its nature, could not 
attack the important aspects and 
kinds of experience. The cry that a 
psychology was wanted which would 
have some usefulness was completely 
justified when the object of attack 
was the kind of introspection advo- 
cated by Titchener. 


ERRORS OF INTROSPECTION 


A characteristic of good science is 
that it is ever alert to the possibility 
of the commission of systematic types 
of errors. One of the major criticisms 
which has been leveled against in- 
trospection is that its results are un- 
trustworthy. In the following few 
paragraphs a brief attempt will be 
made to examine the problem of the 
trustworthiness or validity of intro- 
spective reports. 

There is a respect in which intro- 
spective observations are more trust- 
worthy than observations made by 
the use of the sense organs. Sense 
organs may be defective. Sense or- 
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gans are subject to illusion. Observa- 
tions made with the sense organs are 
subject to the accidents of angle of 
regard, kind of illumination, noise 
level, etc. In the last analysis, the 
sense organs are subject to hallucina- 
tion. Introspection method 
which does not involve the sense 
organs in the usual fashion, and 
therefore all of the error tendencies 
associated with the sense organs do 
not exist for introspection. 

However, introspection has asso- 
ciated with it other sources of error. 
But even at this date, we have 
achieved a certain amount of prog- 
ress in isolating them. We know 
about the stimulus-error. We are 
aware of the tendency to suppress 
data (repression), of the tendency to 
supply socially acceptable data in 
place of other data (distortion, ra- 
tionalization, displacement, etc.). 
But, insofar as we are aware of these 
error tendencies we can take precau- 
tions against their commission. In 
this respect introspection is no differ- 
ent from any other set of methods in 
science. To be aware, for example, of 
the tendency toward rationalization 
stimulates us to challenge our intro- 
spective findings to determine 
whether they have resulted from the 
rationalization process. It isa matter 
of time and careful work to discover 
other error sources. We have dis- 
covered suggestion, cultural deter- 
mination, ethnocentrism, etc.; and 
the list will probably lengthen as our 
experience with the method is en- 
larged. 


is a 


A FUNDAMENTAL DIFFERENCE BE- 
TWEEN CLASSICAL INTROSPECTION 
AND PSYCHOANALYSIS 


Psychoanalysis has one major limi- 
tation with respect to our purposes 
which was not present in classical 
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introspection. This is that the major 
objective of psychoanalysis is ther- 
apy. The major objective of the 
classical introspectionists was the 
acquisition of knowledge. This is a 
fundamental difference. 

Essentially, what is being advo- 
cated in this paper is the use of the 
psychoanalytic method with the ob- 
jective of the classical introspection- 
ists. 

It has been indicated that what is 
being advocated in this paper is 
partly on the grounds of the need for 
a science of psychology which has 
practical implications. However, 
there is an old lesson in the history of 
science of which we avail ourselves. 
Whereas knowledge may have prac- 
ticality as its ultimate objective, it 
has been found that we sometimes do 
better, both practically and theore- 
tically, if we temporarily forsake the 
practical objective. 

In taking the objective from the 
classical introspectionists, it is neces- 
sary to make some modification in 
the psychoanalvtic procedure.  Al- 
though the in: r should be 
“‘free’’ in his « is, he should 
not permit himseif (© wander too far 
from the subject under investigation. 
His associations should stay under 
the influence of the task at hand. Of 
course, as in any investigation, deci- 
sions of relevance have to be made, 
and sometimes only a dim intuition 
dictates the nature of these deci- 
sions. Although there is no a priori 
method for determining relevance, 
the investigator should always at- 
tempt to keep in mind that he is 
serving science primarily, and him- 
self secondarily. 

2 This is true even though Freud did en- 
visage that “the future will probably at- 
tribute far greater importance to psycho- 
analysis as the science of the unconscious than 
as a therapeutic procedure” (7, p. 673). 
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A “MINIATURE” INVESTIGATION OF 

THE RETENTION AND REVELATION OF 

SECRETS BY THE METHOD OF RETRO- 
SPECTIVE ANALYSIS 


In accordance with what has al- 
ready been said the writer attempted 
to conduct an investigation of the 
kind suggested. It is a “miniature” 
investigation in that it was conducted 
only over a very short period of time. 
It was conducted for five days for 
about an hour and a half each day. 

There were several reasons for the 
choice of the topic, retention and rev- 
elation of secrets. One of these is 
that the topic seemed to be one which 
is more amenable to introspective 
investigation than to other methods. 
By its very nature a secret is some- 
thing which may not reflect itself in 
overt behavior. The latter almost 
constitutes a definition of a secret. 
Another reason for the choice of the 
topic is that it seems to be a funda- 


mental one for any kind of introspec- 
tive investigation. 
tant to obtain information concerning 


It seemed impor- 


the nature of secret retention and 
secret revelation before very much 
progress could be made with other 
topics. A third reason was that the 
topic seemed to lie close to the oft- 
stated objective of psychology as 
being prediction and control of hu- 
man behavior. 

The procedure simply involved 
sitting down to the typewriter and 
typing whatever came, after the de- 
cision concerning the topic was made. 
The choice of the typewriter was 
made primarily on the basis that the 
writer has found himself to be more 
fluent this way than either writing by 
hand or talking into a_ recording 
machine. 

By virtue of the nature of the sub- 
ject chosen, the writer attempted to 
write ‘‘as though” the material would 
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never be released. Under any circum- 
stances, even if this was a myth, the 
sense of the possibility of editing was 
not mythical. At the moment the 
writer does not consider it wise to re- 
lease the protocol. However, one 
example will be given. The following 
is taken from the record with some 
editing: 


. .. What is one of the secrets such as thee and 
me have? I once talked to a professor of 
zoology at lunch about the academic life. He 
commented that over the head of every 
academician hangs a sword on a thin string. 
No matter how much you do, you never feel 
that you are doing enough. I am reminded of 
Freud's dream of Irma’s injection. He says, 
“Tl am always careful, of course, to see that the 
syringe is perfectly clean. For / am conscten- 
tious.’ The italics are mine. If he felt that 
he were really conscientious, if he had no feel- 
ings of shortcomings in this connection, why 
did he have to protest that he was conscien- 
tious? ‘The guilt of lack of conscientiousness 
haunts most of my friends. My lack of 
conscientiousness is my “‘secret.’’ But here I 
find myself confessing to lack of conscientious- 
But | was not able to do so until I was 
able to remember something which would 
make it possible for me not to have my guilt 
alone. I brought up the zoology professor. 
When I wrote the above line about him I 
hesitated for a moment on the question of 
whether or not to use quotation marks, or to 
write it in the way that I did. ‘The quotation 
marks would have had to come, in all honesty, 
after the word “‘string.’’ I wrote on, however, 
“*No matter how much you do, you never feel 
that you are doing enough.” This is what I 
would have liked him to have said. I added it 
to give the impression that he had said it, 
but not quite lying about it. 

I think that what has been said above can 
be generalized. We are more prone to confess 
a secret guilt when we can believe that others 
have the same secret guilt.... 


ness. 


The general pattern involved in 
this kind of writing is that of an oscil- 
lation between a free expressive mood 
and an analytic mood, with the free 
expression being the subject of the 
analysis. The question of what a 
given item of free expression might 
mean with respect to the major topic 
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under investigation was repeatedly 
asked. 

In the course of this investigation 
a series of propositions, including the 
italicized one above, were formulated. 
This list can be considered to be the 
yield of this ‘“‘miniature’’ investiga- 
tion: 

1. (Given above.) 

2. Persons with a secret guilt tend 
to create situations in which they can 
“‘see’”’ that others have the same 
secret guilt. 

3. A secret is a secret by virtue of 
the anticipation of negative reactions 
from other people. 

4. A secret is maintained in order 
to maintain some given perception of 
one’s self in others. 

5. Persons who associate with one 
another in the context of a larger 
group, who have a secret from that 
larger group, will create a metaphori- 
cal or otherwise cryptographic lan- 
guage in which to discuss the secret. 

6. In order to conceal a secret one 
may tend to reveal a 
“‘secret,’’ or a less-secret secret, in 
order to generate the impression that 
one is being open and frank. 

7. One of the important secret 
areas in our culture is in connection 
with our intellectual limitations. 

8. When an individual has a secret 
he will attempt to ‘“‘protest’”’ that the 
opposite is the case, if the secret has 
an opposite. 

9. The revelation of a secret may 
involve the attempt to generate the 
impression that one is telling a joke, 
to achieve the double purpose of rev- 
elation on the one hand and 
belief on the other. 

10. In the revelation of a secret 
one may attempt to generate the 
impression that one degrades one’s 
self in one’s own eyes, in order to re- 
duce the degradation that one antic- 
ipates will be the reaction of others 
to the revelation. 


dis- 


fabricated 
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11. If A knows a secret about B, 
and B knows a secret about A, and 
if A discovers that B has revealed A’s 
secret, then A will be inclined to re- 
veal B’s secret. 

12. If an individual changes his 
group identification from Group A 
to Group B, and if Group A has a 
secret which it keeps from Group B, 
that individual will be inclined to re- 
veal Group A’s secret to the members 
of Group B. 


DISCUSSION OF THE ‘ MINIATURE” 
INVESTIGATION 


The simple fecundity of the method 
soon became evident. After the deci- 
sion was made to attempt it and a 
brief beginning was made, it became 
apparent that this was, to use a term 
from the vernacular, a veritable mine 
of information. Essentially it capi- 
talizes on the fact that the investiga- 
tor has had twenty or thirty or forty 
or fifty or sixty or seventy years for 
the collection of various kinds of in- 
formation. Certainly one of the de- 
fects of this kind of data collection is 
that it is not systematic in the usual 
way in which we understand this 
term. Yet it is the result of years of 
trial and error, of a kind which most 
laboratory types of investigation do 
not generally get. It may be argued 
that these data have been uncriti- 
cally gathered. This is a valid point. 
However, the necessary criticality 
can be supplied in the course of the 
investigation itself. 

This kind of investigation can be 
severely hampered by what may be 
loosely designated as ‘‘ethical’’ con- 
siderations. Let us consider, for ex- 
ample, the third proposition enumer- 
ated above, that a secret is main- 
tained in order to maintain a given 
perception of one’s self in others. By 
virtue of the intimate connection be- 
tween ethics, in this larger sense, and 
the kind of data which may become 
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the subject of an introspective in- 
vestigation, it is extremely important 
that the investigator attempt, to the 
degree that he can, to divest the in- 
vestivation of ethical considerations. 
\iethodologically this divesture may 
involve a preliminary investigation 
of the ethical considerations them- 
selves. Also, it must be added that, 
for some kinds of problems to be in- 
vestigated by these methods, less 
may be required in the way of pre- 
liminary investigation than for other 
problems. However, for the investi- 
gation of any problem by these 
methods, a scientific and objective 
attitude is a prerequisite. 

One of the major merits of this kind 
of an approach is that it studies the 
phenomena of psychology directly, in 
a manner which is rarely the case in 
most psychological investigations. 
Actually, the kind of material which 
issues from an introspective investi- 
gation of the kind being advocated is 


let 


presupposed in many other psycho- 


logical investigations. Consider for 
the moment the “‘lie’’ scale of the 
Minnesota Multiphasic Personality 
Inventory. The test presumably 
“gets at” the kind of thing which has 
been investigated in the investigation 
on secrets cited above. However, the 
items of this scale were selected be- 
cause they would presumably be an- 
swered negatively by persons who 
were trying to put themselves ‘‘in the 
most acceptable light socially’ (8). 
This presumes, with little qualifica- 
tion, the content of the fourth propo- 
sition, as well as about 15 preconcep- 
tions concerning the meaning of social 
acceptability. (There are 15 items in 
the ‘‘lie”’ scale.) 

Furthermore, had the makers of the 
MMPI critically examined the na- 
ture of secrets in the way in which it 
has been begun in the above investiga- 
tion, they would have seen that there 
are other dynamics of lying, in addi- 
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tion to the one of which they did avail 
themselves. For example, proposi- 
tion 6 indicates that a certain amount 
of truth-telling may simply be a de- 
vice for ‘covering up’ one or more 
other lies. It may well be that the 
operation of the dynamic indicated 
by proposition 6 acts to depress the 
‘lie’ score when lying is really taking 
place. A full awareness of the kind of 
thing that issues from such an investi- 
gation “an greatly enhance the effec- 
tiveness even of pencil-and-paper 
tests. 

From a more theoretical point of 
view, if we seriously accept the mis- 
sion of psychology as being that of 
the prediction and control of human 
behavior, the psychology of secrets is 
an important link in the chain of 
psychological findings and_ theory. 
Investigators, no matter what they 
are investigating, must be cognizant, 
at the very least, of the possibility of 
dissemblance when they use human 
subjects. To predict and control 
an individual’s behavior it is impor- 
tant to know, for example, his group- 
identifications, his objectives, his 
values, etc. Many of these items of 
information are secret. They may 
even be secret to the subject himself. 
And under any circumstances they 
are ‘not items of information which 
will be revealed readily. Thus, until 
psychologists develop a rather full 
understanding of the dynamics of 
this phenomenon, the ignorance of 
this phenomenon will stand in the 
way of other investigations. 

What has been said in the above 
paragraph would be considerably less 
cogent if the phenomenon of the secret 
played only a small role in connection 
with other phenomena. However, 
secrets play their most important 
role in those phenomena which are 
most vital. A psychology that seeks 
to understand these vital phenomena 
must have an appreciation of the 
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phenomena of secret retention and 
secret revelation. Whether we are 
interested in the problems of mar- 
riage, industrial management, leader- 
ship, prejudice, loyalty, delinquency, 
international affairs, politics, military 
strategy, litigation, business prac- 
tices, economics, etc., the psychology 
of secrets is extremely pertinent. 
And, the psychology of secrets yields 
most effectively to the method which 
is being proposed. 

It might be indicated that an ade- 
quate psychology of secrets would 
represent an extremely important 
contribution to our country in its 
present state. An adequate psy- 
chology of secrets would provide us 
with an insuperable advantage over 
our enemies and potential enemies. 
Concretely, for example, we could use 
the information about the psychology 
of secrets for enhancing the skill of 
the military interrogator in extract- 
ing information from prisoners of 
war; and we could teach our own 
soldiers about techniques 
that may be used against them in the 
attempt to extract information from 
them, so that they may be prepared 
for them. Also, an adequate psychol- 
ogy of secrets might make quite un- 
necessary some contemporary politi- 
cal investigatory practices which 
enjoy some popularity only in lieu of 
more scientific devices. 

Although the psychology of secrets 
is perhaps a central and basic one as- 
sociated with the method, investiga- 
tions could and should be pursued 
with great profit on other problems. 
Thus, for example, problem solving 
and decision making can and should 
be investigated by the method of ret- 
rospective analysis. Investigations 
on status, power, anxiety, fear, ag- 
gression, aesthetic experience, learn- 
ing, Communication, memory, con- 
cept formation, perception, judgment, 


possible 
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charity, loneliness, betrayal, etc. 


could and should be carried out to 
enhance our understanding of these 
phenomena. 


THE PROBLEM OF VALIDITY OF THE 
FINDINGS FROM THE ‘‘ MINIATURE” 
INVESTIGATION 


Perhaps the critical question in the 
mind of the reader up to this point is 
that of the “validity” of the findings 
of an introspective investigation. 
The problem of validity has already 
been discussed previously, but some- 
what abstractly. In this section, the 
problem will be dealt with somewhat 
more concretely, with the findings of 
the ‘‘miniature’’ investigation before 
us. 

The propositions which issued from 
the ‘‘miniature”’ investigation are, at 
least, what may be considered to be 
“hypotheses” for investigation by 
other methods. Thus, at the very 
least, the method may be recom- 
mended as a device for systematically 
getting hypotheses as contrasted 
with, say, the casual reaching out for 
a pair of variables and hypothesizing 
a relationship between them. 

Again, as has already been indi- 
cated, it may be used as a method 
whereby an investigator can bring 
his presuppositions concerning an 
investigation to formulation; where 
he can critically examine his presup- 
positions; and where he might be 
helped in conceiving of other presup- 
positions against which he can con- 
trast the ones he is using. Or, the 
method could be used as a device 
whereby an investigator, having got 
some experimental results which he 
cannot understand, provokes his 
imagination to arrive at some kind of 
an explanation of his results. The 
deliberate and avowed adoption of the 
method would be extremely helpful 
in these respects. 
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However, the writer believes that 
the method warrants more than this. 
As has been indicated, the method has 
a directness which is not to be found 
in any other method of investigation 
of psychological phenomena. In any 
investigation each thing which lies 
between the phenomenon and the 
data is a source of error. These 
sources of error are minimized by the 
method which is being proposed. All 
errors such as failure of the subject to 
cooperate (e.g., rehearsal when in- 
structed not to do so in studies on 
reminiscence), dissemblance, failure 
to comprehend instructions, refusal 
to believe the expressions of the in- 
vestigator’s avowed intentions, fear 
of hidden—or  manifest—micro- 
phones, lack of skill on the part of the 
subject (e.g., fixating a point in a 
vision experiment), refusal to take a 
“naive” attitude (in gestalt experi- 
ments), the lack of control over hu- 
man subjects (e.g., subjects in prob- 
lem-solving studies already knowing 
the solutions to problems but not in- 
forming the investigator), subjects 
knowing the intention of the investi- 
gator (e.g., subjects knowing that the 
experimenter is interested in demon- 
strating a relation bet ween frustration 
and aggression, and therefore conceal- 
ing their felt aggression), etc. are 
minimized in this kind of investiga- 
tion. 

The propositions which were 
yielded by the “‘miniature”’ investiga- 
tion also have a certain kind of self- 
evidence associated with them. They 
elicit the ‘‘of course’ response. Some 
of the propositions may require 
further specification and further qual- 
ification. Nevertheless, they are in 
some sense obvious. It is the sense of 
self-evidence which is associated, 
perhaps, with the axioms of Euclid- 
ean geometry. The nature of self- 
evidence is, of course, an extremely 


115 


difficult problem and perhaps more 
properly falls in the province of the 
philosopher. Or, perhaps, self-evi- 
dence is a problem to be investigated 
by the very methods which are here 
proposed. However, whatever the 
ultimate nature of self-evidence may 
be, there is a sense in which the re- 
sults of an introspective investigation 
are of this type. 

Now, of course, the matter of self- 
evidence may be challenged by the 
question: Self-evident to whom? In 
one respect this as a valid question. 
But in another respect it is not. It is 
valid in that if we are to know that 
it is self-evident it must be self- 
evident to someone. However, when 
the mathematician uses the term 
self-evident he means something which 
is intrinsic to the proposition, rather 
than something dependent upon the 
reader or the hearer of the proposi- 
tion. For the mathematician it is the 
self-evidence of the proposition which 


makes it possible for the person to see 


the self-evidence, rather than the 
reverse. It is this characteristic which 
is shared by introspective proposi- 
tions. 

As a matter of fact, some of the 
propositions which issued from the 
‘‘miniature’’ investigation seem to 
partake of greater self-evidence than 
others. Thus, forexample, proposition 
4 seems to be quite self-evident, 
whereas proposition 5 seems to be 
somewhat less self-evident. And even 
the seeming self-evidence of proposi- 
tion 4 may be quite culture bound. 
However, what has been reported is 
only an extremely limited investiga- 
tion, only a beginning and only a 
sample. Nevertheless, what has been 
presented is enough to suggest the 
possibility of achieving the kind of 
self-evidence that has been indicated. 

Two related, but distinguishable, 
problems are those of replication and 
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generality. Can such an investigation 
be replicated? The answer is affirma- 
tive, although the difficulties of repli- 
cation should be recognized and ac- 
count should be taken of them. If an 
investigator attempts to replicate his 
own investigation at another time, he 
will inevitably be under the influence 
of what he has already done. In repli- 
cating such an investigation, the very 
replication itself should come under 
the scrutiny of the investigator. He 
should challenge, for example, his 
personal identification with the re- 
sults he has already obtained, and 
prepare himself for finding both 
novelty and contradiction with re- 
spect to his earlier investigation. If 
one investigator is interested in repli- 
cating the investigation of another 
investigator, he should carefully take 
into account the possibility of sug- 
gestion, or of his willingness to accept 
the results of the earlier investigator 
(particularly if the first investigator 
has prestige for the second investi- 
gator). He should take careful cog- 
nizance of possible motivation for 
showing the earlier investigator to be 
in error, etc. In some instances it 
may be extremely worth while to in- 
vestigate some topic without reading 
the results of the earlier investigation 
until the completion of the second in- 
vestigation, and the making of a com- 
parison later on. Carefully controlled 
experimentation to determine possi- 
ble effects of suggestion, for example, 
is extremely feasible. 

The generality of the results of 
such an investigation is a somewhat 
more difficult problem, but it is a dif- 
ficulty which is not unique to intro- 
spective investigation. One investi- 
gator’s results can be compared with 
another investigator’s results, so that 
the problem of uniqueness with re- 
spect to a single investigator is viti- 
ated. However, one may ask, in the 
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event of consistency of results among 
a group of investigators, may the 
findings not be unique to a group of 
persons all of whom are introspective 
investigators? There is no easy an- 
swer to this problem. However, we 
face the same problem in other in- 
vestigations. May not the results of 
studies in rote learning be largely 
unique to college sophomores? May 
not the results of studies in, say, 
secondary reinforcement be unique to 
rats, or more particularly laboratory 
rats, or even more particularly white 
laboratory rats, or still more particu- 
larly tamed white laboratory rats, 
etc.? May not all findings concerning 
mental abnormality be unique to 
mentally abnormal persons contacted 
by investigators, and may not these 
very contacts be a major determinant 
of the findings? 

The answer, of course, to each of 
these questions is contingent upon 
some decision concerning relevance, 
a decision that has to be made in 
connection with any investigation. 
Actually, the kind of investigation 
being advocated has an advantage in 
this respect over other kinds of in- 
vestigation. For, in an introspective 
investigation the very decisions con- 
cerning relevance can come under the 
same scrutiny as the phenomena be- 
ing investigated. 


POSSIBILITY AS A FINDING 


The argument concerning the valid- 
ity of the findings from an intro- 
spective investigation thus far has 
been concerned with validity in the 
usual sense, i.e., the argument has 


been concerned with the truth or 
falsity of propositions which issue 
from an introspective investigation. 

There is, however, a value to such 
propositions which is over and be- 
yond their validity. This is their 
possibility rather than their truth or 
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falsity. The knowledge that a certain 
dynamic is possible enhances the 
sensitivity of the psychological ob- 
server. To make this point concrete, 
let us again consider the military 
interrogation situation. Suppose that 
the interrogator is interested in deter- 
mining the contents of some supplies 
which have been moved in by the 
enemy. Now suppose that the prison- 
er being interrogated knows these 
contents but does not wish to reveal 
them. The prisoner may avail him- 
self of the dynamic indicated by 
proposition 6 (the revelation of less 
secret secrets in order to generate the 
impression that he is being open and 
frank), and inform the interrogator 
at length about a great number of 
lesser secrets, but not the nature of 
the supplies. He may say, “I will 
tell you everything that I know, but 
I do not know what was in those 
trucks.”” An interrogator who was 
not aware of the possibility of proposi- 
tion 6 might be lulled into believing 
the man. The interrogator might 
say to himself, “‘he is evidently tell- 
ing all that he knows.” On the other 
hand, an interrogator who is aware 
of the possibility of the action of the 
dynamic indicated by proposition 
6 would be aware of the possibility 
of this kind of deception, and would 
be less likely to be “taken in.” 

Insofar as at least one person can 
contrive such a device for deception, 
then such a device is possible, and 
some other individual may have con- 
ceived of it and may be making use of 
it. The truth of the proposition in 
this respect becomes quite secondary. 
What is important, simply, is that 
someone thought of it; and if one 
person thought of it, other persons 
might think of it. 

In this respect psychologists can 
‘make a major contribution to society 
not only by rendering to society 
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established truths, but also by render- 
ing to society established possibles 
with respect to psychological dy- 
namics. In the matter of prediction 
and control of human behavior, a 
knowledge of what an_ individual 
might possibly do, or possibly feel, 
or possibly think places us well on 
the way toward the achievement of 
our objective. Given a detailed 
knowledge concerning the possibles 
we can act in such a fashion as to 
discourage some from becoming 
actualities, and to encourage others 
into becoming actualities. The prag- 
matic usefulness of knowledge of 
possibles extends from the clinical 
situation to world affairs. 

As has been suggested, these pos- 
sibles may indeed turn out to be 
truths in the larger and more scien- 
tific sense. But even if they fail to 
meet the criteria for general scientific 
propositions, they have value in the 
sense indicated above. 


SUMMARY 


It is the purpose of this essay to 
raise the question of the appropriate- 
ness of the method of introspection 
for rethinking in the perspective of 


modern times. Some features of the 
history of introspection in the first 
decade of the twentieth century have 
been pointed to. The hypothesis is 
advanced that introspection was 
dropped because the classical intro- 
spectionists had come to a_ point 
where they would have had to probe 
the unconscious to make any prog- 
ress. From psychoanalysis we have 
learned that probing the unconscious 
generates anxiety and _ resistance. 
The old distinction between an ex- 
perience, and that of which the ex- 
perience is, is again made. The prob- 
lems of communication of introspec- 
tive observations are discussed. It 
is claimed that introspection should 
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be retrospective, consistent with the 
position of Brentano, Kiilpe, and 
Freud. The problem of errors in 
introspection is discussed. ‘The posi- 
tion is advanced that retrospective 
analysis should take its objective from 
the classical introspectionists and its 
method {rom the psychoanalysts, with 
some modification. A “miniature” 


investigation on the psychology of 
secret retention and secret revelation 
is described. The implications of the 
investigation both as an investigation 
in its own right and as an example of 
the method are discussed. The prob- 
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lem of the validity of the findings is 
discussed, 
tion and generality are discussed. 
The propositions which issue from 
such an investigation can be viewed 
as having three values: first, as hy- 
potheses to be investigated by other 
methods, and otherwise to supple- 
ment 
propositions which have a certain 
kind of self-evidence associated with 
them; third, as possibles which can 
give us real assistance in achieving 
the objectives of prediction and con- 
trol of human behavior. 


The problems of replica- 


other methods; second, as 
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The use of check lists, charts, and 
rating scales for the objective record- 
ing and later evaluation of change in 
the behavior and symptoms of psy- 
chiatric patients is not new. Devices 
such as the Phipps Psychiatric Clinic 
Behavior Chart (4) have been used 
for a half century on psychiatric 
wards to record patient change. 
Plant (17) reported a rating scheme 
for describing patient behavior on 
the ward in 1922. In 1933, Moore 
(14) published his chart and “Schema 
for the Quantitative Measurement 
of Abnormal Emotional Conditions” 
containing some 36 carefully con- 
structed scales. The interest in men- 
tal health problems intensified by 
events in World War II resulted in 
a marked upswing in the develop- 
ment of procedures for the objective 
measurement of psychopathology and 
personality change. It is the purpose 
of this review to examine briefly 
those rating scales and check lists 
designed to describe psychiatric pa- 
tients on the ward or in the interview, 
which have appeared during the past 
ten years. 


SCALES FOR USE BY PSYCHIATRIC 
AIDES AND NURSES 


Six scales suitable for use in mental 
hospitals by nurses and psychiatric 
aides have been reported. These are 
generally designed to secure (a) 
quantified descriptive reports of read- 
ily observable patient ward behavior, 
and (b) quantitative estimates of 
hospital adjustment. The first of 
these, the Gardner Behavior Chart 
(22), a rating scale developed by 
Wilcox out of work with psychotic 


patients, is designed to secure re- 
ports of easily observed patients’ 
ward behavior from nurses and at- 
tendants. The 15 categories or scales 
used are: attention to personal ap- 
pearance, sleep, appetite, sociability, 
activity control, noise disturbance 
control, temper control, combative- 
ness control, care of property, self 
entertainment, cooperation in rou- 
tine, work capacity, work initiative 
when alone, work initiative when 
closely supervised, and willingness to 
follow directions. Under each cate- 
gory five brief phrases characterize 
the grades of behavior in the scale. 
The rating grades are none, poor, 
fair, good, and extra good; they are 
weighted from 0 to 4. The total 
score consists of the sum of the 15 
ratings received. The Behavior 
Chart has been found useful in the 
evaluation of change following pre- 
frontal lobotomy (21). 

The Fergus Falls Behavior Rating 
Sheet, prepared by Lucero and Meyer 
(10), was developed to record be- 
havior of patients who are mute, un- 
intelligible, hyperactive, or seclusive. 
Eleven aspects of behavior, such as 
work, response to meals, and response 
to patients, are rated by checking 
one of five descriptions. A value of 
1 is given to the most deviant be- 
havior and a 5 to presumed normal 
behavior. Thirty-four raters, on 
rating 51 patients, agreed 90 per cent 
of the time even though some of the 
language used in the description ap- 
pears to be sufficiently ambiguous 
and difficult as to require extended 
training. A similar but briefer de- 
vice, the Norwich Rating Scales, for 
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recording patient behavior on dis- 
turbed wards, has been developed by 
Cohen, Malmo, and Thale (2). The 
ward nurse or attendant checks one 
of five descriptions of activity, ag- 
gressiveness, destructiveness, resis- 
tiveness, talkativeness, and tidiness. 
To check the reliability of the indi- 
vidual scales, 10 patients were rated 
independently by two raters. The 
average interjudge coefficient re- 
ported was .76. 

Rowell (18) has reported a graphic 
rating scale of 20 items for use by 
psychiatrically trained nurses. Indi- 
vidual scales are 5-point continua 
extending from normality on one 
end to pathology on the other. 
Variables such as preoccupation, hal- 
lucinations, delusions, affect, mood, 
blocking, and “‘flight of ,ideas,”’ are 
rated. The reported immediate test- 
retest reliability for 71 total scores is 
.95, while the correlation between in- 
dependent ratings by nurses for 62 
pairs is .85. The descriptive state- 
ments preceding the scale cues ap- 
pear far too terse and lacking in 
definition for terms such*as*blocking 
and flight of ideas that are ill-defined 
and notoriously difficult to judge. 

The Hospital Adjustment Scale, 
an ingenious, carefully constructed 
device for evaluating patient's be- 
havior, has been developed by Fergu- 
son, McReynolds, and Ballachey 
(11). The scale consists of 91 state- 
ments descriptive of psychiatric pa- 
tients, such as ‘‘the patient ignores 
the activities around] him,” or “‘the 
patient's talk is mostly not sensible.”’ 
Each statement is marked as True, 
Not True, or Does Not Apply, for a 
given patient, and is keyed in such a 
manner that it is possible to obtain 
a total score indicative of the pa- 
tient’s general level of hospital ad- 
justment. The scale can be filled 
out in about 10 minutes by the psy- 
chiatric aide or nurse most familiar 
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with the day-to-day behavior of the 
patient over a period of two weeks to 
three months. In addition to the 
total adjustment scores, the scale 
also offers measures descriptive of (a) 
communication and interpersonal re- 
lations, (b) care of self and social 
responsibility, and (c) work, recrea- 
tion, and other activities. The state- 
ments can also be grouped as to 
whether they are indicative of an 
“expanding” personality, a ‘“‘con- 
tracting’’ personality, or whether 
they are neutral. The Hospital Ad- 
justment Scale was developed from a 
pool of statements descriptive of pa- 
tients, secured from psychiatric aides. 
Statements were selected for the final 
form on the basis of measures of inter- 
judge reliability, ratings made by 16 
judges on a scale of over-all hospital 
adjustment, checks of discriminative 
power, and percentage of True, Not 
True, and Don’t Know checks. 
Norms based on the records of 518 
patients from four hospitals and 
clinics are available in percentile 
form. Patients approaching release 
from hospital can be differentiated 
significantly from those judged to 
be extremely disturbed or chronic 
hospital residents. 

Scherer (20) has prepared a set of 
44 four-point scales for the evaluation 
of patient behavior in such activities 
as occupational therapy, manual 
arts, corrective therapy, educational 
therapy, recreation, and library visits. 
The Activity Rating Scales were con- 
structed on the basis of a longer list 
of patient behaviors and tested out 
on rehabilitation staff personnel. In- 
dependent ratings of the same 
group of patients indicated that, of 
1,188 pairs of independent ratings, 60 
per cent agree completely, 28 per 
cent differ by one scale interval, 3 
per cent by two scale intervals, and 
8 per cent of the scales are not rated. 
Inasmuch as the activities observed 
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in rehabilitative situations are simi- 
lar to noninstitutional, vocational, 
and social activities, the author 
postulates that the behavior exhibited 
may also be similar to and predictive 
of behavior shown in _ posthospital 
adjustment. 


SCALES FOR USE BY TRAINED 
CLINICIANS 

The scales and check lists to be 
described in this section were de- 
veloped primarily for use by trained 
clinicians. Most of them represent 
efforts to secure records of currently 
observable behavior, symptoms, com- 
plaints, or inferable needs and atti- 
tudes. A few, however, are intended 


to secure evaluations of social history 
obtained from the patient or the pa- 
tient’s friends and relatives. 

The Elgin Prognostic Scale, con- 
structed and validated by Wittman 
and Sternberg (28, 29), is a rating 
schedule designed to predict recovery 


in schizophrenics. It consists of 20 
rating scales weighted according to 
prognostic importance; favorable fac- 
tors are arbitrarily assigned negative 
weights and unfavorable factors are 
assigned positive weights. The prog- 
nostic score is the algebraic sum of 
the weighted measures. Most of the 
variables, such as shut-in personal- 
ity, type of onset, or range of in- 
terests, are based upon premorbid 
social’ history secured from the pa- 
tient’s relatives or from the patient 
himself. A few are based on cur- 
rently discernible symptomatology 
such as hebephrenic symptoms, ideas 
of influence, bizarre delusions, or 
affect. These scales were con- 
structed following a review of availa- 
ble literature on prognostic factors in 
schizophrenia. They were validated 
and cross-validated on Elgin State 
Hospital patients, and shown to pre- 
dict outcome of shock treatment with 
greater accuracy than staff judg- 
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ments. A multiple-factor analysis (6) 
of intercorrelations between the 
scales based on a group of 200 pa- 
tients revealed three interpretable fac- 
tors: schizoid withdrawal, schizo- 
phrenic reality distortion, and per- 
sonality rigidity or inadaptability. 
The principal shortcoming of this de- 
vice is the difficulty of securing relia- 
ble premorbid personality pictures 
from parents and relatives. 

Saslow and his associates (19), in 
their effort to study the personality 
correlates of psychosomatic disorders, 
have prepared some 12 scales for 
measuring habitual patterns of reac- 
tions to crises. Each pattern is 
briefly delineated by means of a 5- 
point scale. Ratings are based on 
social history data secured from pa- 
tients during psychiatric interview. 
Included are scales of impulsiveness, 
subnormal assertiveness, obsessive- 
compulsive behavior, depressive be- 
havior, anxiety, hysteria, inward ex- 
pression of emotions, low awareness 
of body symptoms, insecure feelings 
of inferiority, repressed hostility, and 
strong dependent needs. No relia- 
bility data are reported for the indi- 
vidual scales. 

A check list resembling the Phipps 
Clinic Chart, but more systematic in 
its approach, has been developed by 
Peters (16). The check list, which 
consists of 199 traits, is grouped 
under 7 categories: history, acting, 
talking, mood, emotion, interests, 
ideation. The traits were compiled 
from interview records and presum- 
ably cover a large proportion of all 
characteristics required to describe a 
patient’s personality and symptoms. 
Three ratings are used: a plus for a 
positive degree of a trait, no mark at 
all when a trait is present to a normal 
degree or does not pertain to the sub- 
ject, and a minus sign for a negative 
degree of the trait. Ward behavior, 
interview data, and social history 
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may be taken into account in rating. 
The check list has been used success- 
fully to identify traits related to im- 
proved adjustment of lobotomized 
patients (16). 

A mental health check list entitled 
The Pattern for Living has been con- 
structed and reported by Conrad (3). 
The check list is designed to measure 
positive mental health, social con- 
formity, and pathology. It is for use 
by trained personnel in appraising 
persons applying for and receiving 
outpatient psychotherapy. very 
item regarded as true is checked plus, 
false items are checked minus, while 
the remainder may be scored by a 
question mark. Trends are indicated 
in a separate column. Of the 45 
items, 16 are concerned with positive 
mental health, 12 with conformity, 
and 17 with pathology. Evidence is 
presented that patients with high 
positive mental health scores tend to 
stay in therapy (3). 

A Guided Clinical Interview Anal- 


ysis for use in connection with struc- 


tured clinical interviews has been 
reported by Abt (1). Eight scales 
descriptive of attitude toward par- 
ents, attitude toward siblings, atti- 
tude toward childhood, attitude 
toward people in general, and atti- 
tude toward sex make up the Anal- 
ysis. Each subcategory of a scale is 
ratable on a 5-point scale. Agreement 
between raters for recorded interview 
material is reported to be high. A 
scale similar to the Abt form as to 
content, for use in evaluating adult 
outpatients receiving psychotherapy, 
is being developed by Morse (15). 
The six major areas measured are ac- 
cessibility to therapy, occupational 
and school adjustment, social adjust- 
ment, sexual adjustment, family ad- 
justment, and symptomatology. 
Most of the 40 items contain four 
brief descriptions to characterize 
grades of behavior on the scale con- 
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tinuum. Thus far neither reliability 
nor validity data are available. 

The Psychiatric Rating Scales de- 
veloped by Malamud et al. (13), at 
the Worcester Hospital in Massachu- 
setts, represent yet another rating 
form for the quantitative recording 
of psychiatric clinical findings and 
the changes that occur in them during 
the course of illness. The scale con- 
sists of 19 “functions” divided into 
three major groups. The first seven 
functions comprise behavior items, 
such as sexuality and sleep, which de- 
pend upon continuous observations 
by ward personnel during the 24 
hours preceding the psychiatric rat- 
ings. The third group consists of 
eight functions that are evaluated 
during the interview and require ver- 
bal reactions from the patients them- 
selves. Associations, memory, and 
thought processes are examples of 
these eight functions. 

Each of the 19 scales extends to the 
left and to the right from a central 
base line consisting of two terms 
which represent the usual variations 
in the particular function that is 
within normal limits. On both sides 
of the base line are indicated the 
range of deviation in terms of pro- 
gressive degrees of pathology. On the 
left side of the scale are those devia- 
tions which are directed toward the 
outside (centrifugal). To the right of 
the base line are those centripetal or 
internally directed deviations in the 
function. Steps in the function are 
identified by three psychiatric terms 
to the left of the base line and three 
to the right. Ratings made for either 
half of a function may range from 1 
to 6. The Feeling function, for exam- 
ple, is marked by the following se- 
quence of terms: panic, anxiety- 
guilt, tense-irritable, hypersensitive, 
hyposensitive, phlegmatic, dull, apa- 
thetic. A patient’s total score con- 
sists of the sum of his scores on each 
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of the 19 functions. A correlation of 
.92 was secured between 100 paired 
independent ratings made by two 
psychiatrists on 26 patients. Applica- 
tion of the Psychiatric Rating Scale 
to agitated depressives (12) indicates 
a good correlation with changes in 
the clinical picture resulting from 
electroshock therapy. The scale has 
also been used to record changes re- 
sulting from prefrontal lobotomy. 

A criticism that may fairly be di- 
rected at the Psychiatric Rating 
Scales is that the terms used to de- 
scribe the 19 functions are nowhere 
defined. This would suggest that 
ratings on individual functions are 
less reliable than the total scores. In 
total scores, differences between 
raters are cancelled out in the process 
of summing. Lockwood (5) reports 
that the evaluations of his psychiatric 
raters as_ reflected on individual 


scales were not sufficiently reliable for 
use as criteria for clinical improve- 


ment. In a number of the scales 
several variables seem to have been 
forced into a single bipolar contin- 
uum. ‘Thus, instead of one rating 
there should be two on such functions 
as Sexuality. It would have been 
preferable to determine empirically in 
advance whether or not presumably 
antithetical forms of behavior were 
mutually exclusive. 

The Elgin Behavior Rating Scale 
Revised has been developed by 
Wittman and Hills (29) for the pur- 
pose of describing psychiatric pa- 
tients in six areas of behavior. A rating 
is accomplished by selecting the de- 
scriptive sentence listed under a cate- 
gory which is most applicable to the 
patient. 


The scales are graded from 
‘very poor”’ to “‘very good.”’ A weight 
of 0 is given to the most deviant 
behavior; intermediate steps are as- 
signed weights from 1 to 4. Somatic 
behavior is covered by seven scales 
descriptive of physical appearance, 
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physical condition, appetite, and the 
like. ‘The Social Behavior area con- 
sists of six scales descriptive of such 
aspects as conversation, cooperation, 
and sex behavior. There are eight 
scales to describe Mental Behavior 
such as orientation, insight, and af- 
fective response. Under the rubric of 
Psychotic and Neurotic Behavior are 
three global scales descriptive of af- 
fective exaggeration, paranoid pro- 
jection, and schizoid withdrawal. 
Neurotic Behavior and Anti-Social 
Behavior are separately rated on two 
scales. No data with regard to inter- 
rater agreement are reported. Most 
of the scales contain several variables 
for rating. The orientation scale, for 
example, includes items relative to 
disorientation as to time, place, and 
person. There are actually 63 sepa- 
rate variables available for rating. 
Although no data are provided by the 
authors, the total score would proba- 
bly represent a useful measure of 
over-all severity of illness. 

A series of check lists designed to 
describe patient character, tempera- 
ment, and intellectual capacity have 
also been developed by Wittman (29) 
and her associates. The check list of 
Fundamental Temperament Reac- 
tions postulate three bipolar com- 
ponents. The first component, affec- 
tive exaggeration, extends from 
manic expansion to depressive con- 
striction. Aggressive ascendance and 
defensive passivity mark the two 
ends of a continuum of paranoid com- 
pensation. ‘The schizoid withdrawal 
component extends from heboid re- 
gression to simple withdrawal. Two 
descriptive elements identify manic 
expansion and a similar number are 
used to describe depressive constric- 
tion. The rater may check as few or 
as many elements as he observes; the 
total number of checks provides a 
total score. Wittman has also con- 
structed check lists for Temperament 
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Deficiencies, Anxiety Reactions, 
Character Deficiencies, Exaggerated 
Reaction Types, Addictive Reaction 
Types, Disorders of Intellectual Ca- 
pacity, Constitutional Intelligence 
Disorders (Amentia), and Acquired 
Intelligence Loss (Dementia). 

Wittenborn (23) has reported a 
rating-scale procedure for the evalua- 
tion of mental hospital patients as 
one step in a broad program directed 
at the development of a quantified 
method for multiple pyschiatric diag- 
noses. The procedure was devised to 
permit a psychologist, psychiatrist, 
nurse, or other competent observer 
to (a) rate the currently discernible 
symptoms of a psychiatric hospital 
patient, (b) score these ratings, and 
(c) prepare a profile which would in- 
dicate to what extent the patient's 
pattern of symptoms resembled the 
symptom patterns found among psy- 
chiatric hospital patients generally. 
The rating schedule consists of 55 dif- 
ferent, unlabeled scales presented 
sequentially in a random manner. 
The scales were selected to represent 
a fairly adequate sample of important 
symptoms that characterize hospital- 
ized patients. They were designed to 
demand a minimum of interpretation 
and experience from the observer, 
and to yield judgments which are 
relatively unbiased by the rater’s 
particular theory or point of view. 
The directions require that the rater 
check the most pathological condition 
or level of behavior observed during 
the period studied and that every 
scale be checked for every patient. 
This last procedure undoubtedly 
facilitates correlational studies. 
However, there is a real question as 
to how much error is introduced if 
judgments are forced as in the case of 
the mute patient or the patient who 
is evasive or irrelevant in his speech. 
A mute patient, for example, must be 
judged as to rate of change of ideas, 
insight, or rate of speech. 
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Most of the scales consist of four 
elements; a lesser number contain 
three or five elements. The rating 
process, which consists of encircling 
one element for every scale, requires 
about 10 or 15 minutes. 

In an effort to determine the exist- 
ence of clusters on patterns of symp- 
toms and the influence of such char- 
acteristics of the sample as age, sex, 
or organic brain damage on these pat- 
terns, Wittenborn (24, 25) has com- 
pleted a series of factorial analyses of 
his rating schedule. The nine factors 
or psychiatric syndromes which have 
been repeatedly identified are: Acute 
Anxiety, Conversion Hysteria, Manic 
State, Depressed State, Schizophren- 
ic Excitement, Paranoid Condition, 
Paranoid Schizophrenic, Hebephren- 
ic Schizophrenic, and Phobic-Com- 
pulsive. Scoring weights for the 
symptom scales and norms for trans- 
muting cluster scores into standard 
cluster scores are available for the 
Descriptive Scales for Rating Cur- 
rently Discernible Psychopathology. 

The Multidimensional Scale for 
Rating Psychiatric Patients 
(MSRPP) consists of two sets of 
brief, relatively objective rating 
scales for the description of the be- 
havior, symptoms, complaints, and 
inferred motivation of psychiatric 
patients. One form or set is for out- 
patient use and the other for hospital 
use. These schedules represent a 
systematic effort to (a) develop a 
quantified record or description of 
mentally ill patients that could be 
used to measure change or improve- 
ment, and (b) isolate and identify 
underlying unitary variables. The 
form for outpatient use, developed by 
Lorr, Jenkins, Holsopple, and Rubin- 
stein (8), consists of 49 unlabeled, 
randomly presented, 4- and 6-point 
graphic rating scales for describing 
outpatients as seen in diagnostic or 
therapeutic interview. It is intended 
only for use by psychologists or psy- 
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chiatrists. The scales, calling for 
judgments based on directly observa- 
ble manifest behavior, are grouped 
together, as are those which require 
inferences. Included are scales de- 
scriptive of personality traits such as 
emotional responsiveness, complaints 
such as headaches, and symptoms 
such as compulsive behavior. The 
schedule provides scores for 16 fac- 
tors identified on an original set of 73 
(9). Tentative norms and standard 
scores for profiling individual patient 
records are available. The factors 
measured by this form have been 
labeled Hostility, Reality Distortion, 
Obsessive-Compulsive Reaction, Sex 
Conflict, Gastro-Intestinal Reaction, 
Cardiorespiratory Reaction, Anxiety- 
Tension, Anxious Depression, Emo- 
tional Responsiveness, Adaptability, 
Sense of Personal Adequacy, Vigor- 
ous Interest, Conscientiousness, In- 
dependent Maturity, Goal-Directed 
Motivation, and Prudence. 


The MSRPP form for hospital use 
represents a revision of the Northport 


Record, which was_ initially 
structed and developed by Lorr, 
Singer, and Zobel (7). It consists of 
50 unlabeled graphic rating scales 
presented in a random order. The 
schedule was designed to measure the 
major symptoms characteristic of rec- 
ognized syndromes of the various 
psychoses and behavior readily ob- 
servable in a routine diagnostic inter- 
view or on the ward by nurses and 
psychiatric aides. A rating is made 
by encircling the entry which is most 
typical or representative of the pa- 
tient during the period observed. 
When there is no basis for rating a 
patient on a particular scale, an un- 
ratable category is encircled. 

The hospital form of the MSRPP 
provides tentative norms, based on 
450 patients from four psychiatric 
hospitals, for 12 factors or syndromes 
measured. These factors were identi- 
fied in a multiple-factor analysis of 


con- 
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55 of the original 81-item Northport 
Record. Standard score measures are 
available for profiling a patient on 
the following factors: Manic Excite- 
ment, Retarded Depression, Anxious 
Depression, Perceptual Distortion, 
Conceptual and Thinking Disorgani- 
zation, Paranoid Suspicion, Grandi- 
ose Expansiveness, Schizophrenic Ex- 
citement, Disorientation, With- 
drawal, Hostile Aggressiveness, and 
Activity Level. The last three of 
these factors are behavior parameters 
observed on the ward. 

The sum of the absolute deviations 
from a “‘normal”’ pattern provides an 
over-all index of severity of illness 
which has been found to reflect 
change resulting from lobotomy. 
Seven type patterns similar to con- 
ventional diagnostic description are 
also available for use as an aid in 
diagnosis. 

DISCUSSION 

The development and use of rating 
scales and check lists for the system- 
atic recording of clinical judgments 
of manifest behavior and inferred at- 
titudes and needs appear to represent 
an important advance for the clini- 
cian and the research worker. 

There seems to be no doubt that 
the interview is here to stay even 
though some critics, particularly the 
psychometricians, would have it re- 
placed by other and presumably more 
rigorous procedures. ‘The problem 
becomes one of developing controlled 
interview patterns as suggested by 
Zubin (31) and of objectively record- 
ing what the trained clinician can 
validly or reliably observe or infer. 
While the new techniques for sound 
recording of interviews are unques- 
tionably important for evaluation, 
they are not substitutes for the clini- 
cian nor do they provide any com- 
plete basis for the analysis of the in- 
terview. Visual as well as auditory 
cues provide important data for an 
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appraisal. We are simply saying, in 
brief, that the clinician can contrib- 
ute toward the description of his 
patient and the prediction of his 
future behavior. The rating form 
provides a framework for quantifying 
his judgments, for jogging his 
memory, and for minimizing “halo”’ 
bias. 

The rating schedule also offers a 
common conceptual framework for 
the clinician regardless of the exami- 
nation procedure used. Clinical judg- 
ments derived from an analysis of the 
Rorschach test, the TAT, or a sen- 
tence completion form may be re- 
corded in objectified form on the rat- 
ing scales. Ratings can be useful in 
defining and clarifying areas of agree- 
ment and disagreement. Clinicians 
differing in theoretical orientation 
can find a common ground when a 
concept characteristic of an individ- 
ual is stated simply, in graded form. 
When defined in simple understanda- 
ble terms, many presently elusive and 
amorphous variables can be checked 
for reliability and related to a larger 
domain of objectively expressed con- 
cepts. Conceptual formulations often 
loosely used, such as sexual identifica- 
tion or ego strength, can be pinned 
down for closer scrutiny and valida- 
tion. 

In any field where agreement on 
basic variables is lacking, factor anal- 
ysis is a powerful tool for resolution 
of complex concepts into simpler ele- 
ments and for the identification of 
underlying parameters. ‘The confu- 
sion in, and duplication of, vocabu- 
laries for describing personality and 
psychodynamics are especially nota- 
ble. However, Moore, Wittenborn, 
and others (14, 25) have shown that 
rating scales and check lists can be 
utilized fruitfully for the isolation 
and identification of psychopatho- 
logical syndromes and categories. 
Investigators concerned with the iso- 
lation of primary factors in percep- 
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tion and cognition have recently 
recommended a battery of tests to 
represent each of the better defined 
factors in future factorial studies. In 
the absence of more objective meas- 
ures of personality and psychopath- 
ology, it may be useful to utilize simi- 
larly, as reference variables, standard 
sets of rating scales in further fac- 
torial investigations. 


SUMMARY 


The purpose of this review has been 
to examine and report on rating scales 
and check lists designed to describe 
psychiatric patients in the interview 
and on the ward that have appeared 
during the past ten years. A_ half 
dozen scales and check lists suitable 
for use by nurses and _ psychiatric 
aides is reported in the literature. Of 
these devices the Hospital Adjust- 
ment Scale has been most carefully 
developed and seems to be usable by 
any psychiatric aide who can read. 
For more precise measurement of 
change the Gardner Behavior Chart 
and the Northampton Activity Rat- 
ing Scale may be preferable. 

Among those designed for use by 
psychologists and psychiatrists to de- 
scribe psychotic behavior and symp- 
tomology, the Wittenborn Descrip- 
tive Scales and the Multidimensional 
Scales have been most intensively 
analyzed and developed. The Elgin 
Prognostic Scales are at present the 
most useful for predicting improve- 
ment although difficult to use because 
of the practical problem of securing 
reliable data on the patient’s past 
history. 

The rating schedule offers consider- 
able promise as a procedure for quan- 
tifying the interview, for isolating 
basic psychopathological parameters, 
and for generally providing a concep- 
tual basis against which clinicians of 
varying persuasions and training can 
find a common ground. 
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RECENT STUDIES OF SIMPLE REACTION TIME!? 


WARREN H. TEICHNER 
Aero- Medical Laboratory, Wright-Patterson Air Force Base 


In spite of the important role that 
the human reaction time study has 
played in the development of psycho- 
logical science and the tremendous 
amount of research effort expended 
in its behalf, there are still large gaps 
in our knowledge of the empirical re- 
lationships in which reaction time is 
involved. This report is an assess- 
ment of the present scientific status 
of the topic based primarily on the 
experimental literature of the last 
twenty years. Previous reviews were 


presented by Woodworth (161) in 
1938 and by Johnson (82) in 1923. 
In addition, Forlano, Barmack, and 
Coakley (50) have reviewed the ef- 
fects of ambient and body tempera- 
ture on both simple and choice reac- 


Finan, Finan, and 
Hartson (46) have briefly sum- 
marized the of reaction time 
scores as measures of performance 
decrement. 

First, it should be noted that there 
are several kinds of reaction time ex- 
periments (8, 161). Because of the 


tion time and 


use 


! This paper is a revision and extension of 
The Simple Reaction Time, a Review with 
Reference to Air Force Equipment, Wright 
Air Development Center Technical Note 
WCRD 52-47, August 1952, which was written 
when the author was on the staff of the Psy- 
chology Branch, Aero-Medical Laboratory, 
Wright Air Development Center. The writer 
is now with the Human Resources Branch, 
Natick QM Research & Development Labora- 
tory, Natick, Massachusetts. 

? Thanks are due to many people for their 
comments, and in particular to Mr. Darwin 
Hunt and Dr. Davis Howes of the Aero- 
Medical Laboratory, and Dr. Austin Henschel 
of the Natick QM Research and Development 
Laboratory. 
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tremendous literature involved, the 
present discussion will be restricted to 
the simple reaction time (RT), which 
is the time interval between the onset 
of the stimulus and the initiation of 
the response under the condition that 
S has been instructed to respond as 
rapidly as possible. In order of pres- 
entation this review will consider 
the effects on the RT of stimulus and 
receptor conditions, central and 
motor factors, and certain special 
conditions such as the effects of low 
ambient temperature, loss of sleep, 
Cv. 

Next, the complexity of the meas- 
ure should be recognized. After the 
onset of the stimulus there is a lag, or 
latent period, during which the re- 
ceptor process is initiated and builds 
up to a maximum (25, 56, 119, 120, 
140, 141). This is followed by a 
second lag involving central trans- 
mission of the sensory impulses to the 
motor fibers, and finally, there is a 
time delay involved in the contrac- 
tion of the muscles (33, 34, 47, 67, 
127) and the beginning of the move- 
ment of the responding member. Any 
of the factors which affect any of 
these processes will obviously also 
affect the measured RT within which 
they are present. Since most RT 
studies deal only with the over-all 
measure of time, the present discus- 
sion will be confined to this measure. 
However, a discussion of sensory 
latent periods relevant to the visual 
RT may be found in Arnold and 
Tinker (2) and in Strughold (140, 
141), to the auditory RT in Chochell 
(24, 25), to the pain RT in Pattle and 
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Weddell (117), and to the thermal 
RT in Wright (162). Piéron (120) 
summarizes the topic in considerable 
detail. 


STIMULUS- RECEPTOR FACTORS 


RT as a Function of the Sense Modal- 
ity Stimulated 


It is a common assumption based 
on the neuro-anatomical differences 
existing among the various receptor 
systems that the time of reaction 
varies according to the sense mo- 
dality stimulated. Textbooks usually 
contain comparisons between the 
RT’s obtained by various kinds of 
stimulation, frequently presenting 
lists in which RT is ranked according 
to the senses. However, little atten- 
tion appears to have been given to 
the logic of measurement involved in 
making such comparisons. For exam- 
ple, in order to say that the auditory 
RT is shorter than the visual one, as 
is usually done, the two types of 
stimulation must be compared on the 
same scale. The scales that have been 
employed are, unfortunately, scales 
of subjective intensity and _ these 
cannot be considered comparable 
from one sense modality to another. 
This argument, i.e., that the attribute 
terms of one psychophysical dimen- 
sion logically cannot be projected to 
another such dimension, represents 
what is usually thought of as an ad- 
vance in the logical foundation of 
psychology and will be remembered 
as having invoked considerable dis- 
cussion.* Although the problem was 
resolved with regard to the compar- 
ing of sensations, it seems to have 
been ignored in dealing with the RT. 
For this reason, the conclusion that 
must be drawn is that there is no evi- 
dence available that indicates whether 


3 For a complete statement of this problem 
see Boring (10). 
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or not the RT varies according to the 
receptor system stimulated. 

The experimental literature availa- 
ble does allow one kind of meaningful 
conclusion regarding this matter. 
Where studies have been done com- 
paring a specific intensity of, say, 
sound with a specific intensity of, 
say, light, it should be possible to 
decide whether the RT’s for those 
specific values, and those only, are 
shorter for the one sense than for the 
other. Unfortunately, most studies 
making such comparisons either re- 
port no intensity values at all, or 
they report them in arbitrary units 
with no means of reference. 

It is possible, of course, to specu- 
late. The literature concerned with 
visual and auditory RT's is almost 
universal in reporting faster RT's to 
the sound stimuli than to other 
stimuli. Most studies have also found 
faster KT’s to tactual than to visual 
stimuli. Robinson (125), for exam- 
ple, presented a summary table of 
eight of the older investigations in 
which the RT's for vision, hearing, 
and touch were compared. If medi- 
ans are calculated from this table, 
the RT for audition is found to be 
0.142 sec., for touch 0.155 sec., and 
for vision 0.194 sec. In all eight of the 
experiments, the auditory RT was 
consistent in being faster than the 
visual one. But in four of the eight, 
the tactual RT was faster than the 
auditory one and in the other four 
the opposite result was obtained. 
Todd (146), and in addition more 
recent studies (4, 16, 38, 48, 153, 
154), concur in finding shorter RT's 
to sound than to light. One other 
study (Moldenhauer) reviewed by 
Woodworth (161) found the auditory 
kT faster than the tactual one. 
Lanier (92), however, in a study of 
the effect of training on auditory, 
visual, and tactual RT’s found the 
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tactual RT shortest for trained Ss 
with the auditory and visual RT’s 
being approximately equal. With 
untrained Ss, on the other hand, the 
auditory RT was shortest with visual 
and tactual times being equal. 

It is possible that the speed of 
reaction with respect to sensory 
modality may depend on some sort of 
speed or reaction factor which deter- 
mines the kind of stimulus to which 
an individual will exhibit the shortest 
RT. Wells, Kelley, and Murphy 
(153, 154) studied the ratio of the 
median RT to light to the median 
RT to sound and found a light-sound 
ratio of 1.15 for 11 untrained Ss. 
Two trained Ss exhibited ratios of 
1.34 and 1.45. They also found a 
correlation of —.52 between the ra- 
tios and the median RT to sound in 
the untrained group. From this they 
concluded that Ss who have a rela- 
tively fast RT to sound have a rela- 
tively slow RT to light, and vice 
versa. The ratios obtained agree 
fairly well with those recently re- 
ported by Canfield, Comrey, and 
Wilson (16). However, the correla- 
tion of —.52 has little meaning since 
it is logically possible to obtain a 
negative correlation between a ratio 
and its denominator even when the 
direct correlation between the numer- 
ator and the denominator is positive. 
In fact a negative correlation merely 
indicates that the ratio is greater 
than 1.00. More direct comparisons 
by Forbes (48) and by Lanier (92) 
have revealed positive correlations of 
48 and .90 respectively between re- 
sponse to light and to sound. 

Irom a consideration of chemical, 
temperature, pressure, or electrical 
stimuli applied directly to the skin to 
elicit pain response, Woodworth (161) 
concluded that the slowest RT is that 
based on painful stimulation. Recent 
studies have also recorded pain RT's 
to radiant heat (e.g., 61, 139, 156) 
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and radiant cold (35). It is neces- 
sary, however, to consider not only 
the measurement problems invol.ed 
but also the logical and technical dif- 
ficulties involved in the measurement 
of pain (37, 61). 

Wright (162) investigated the RT’s 
associated with cutaneous sensations 
of warmth elicited by visible and in- 
frared radiation. In 22 out of 39 men 
tested, RT was faster to stimulation 
on the back of the hand than it was 
on the palm. In 17 out of 27 others 
who were tested, stimulation in the 
epigastrium produced faster RT’s 
than stimulation in the interscapular 
region. In 78 Ss the RT to light was 
found to vary from about 0.33 sec. for 
a very intense sensation to about 20 
sec, at threshold. One interesting re- 
sult was that psychophysical func- 
tions obtained with RT measures 
showed a qualitative similarity to vis- 
ual functions of intensity, duration, 
and area. 

A little work has also been done re- 
cently on proprioceptive RT’s. Cher- 
nikoff and Taylor (21) measured the 
speed of reaction to the sudden falling 
of the S’s arm. When the response 
measure was the time of release of a 
telegraph key, no differences were ob- 
tained between auditory, tactual, and 
kinesthetic RT's. However, when the 
response was the stopping of the arm 
movement, RT was considerably 
shorter than the key-release type of 
reaction regardless of whether the lat- 
ter was to an auditory, tactual, or 
kinesthetic stimulus. Hick (72) and 
Vince (152) have also studied the 
RT’s involved in making corrective 
movements in a pursuit task involv- 
ing both visual and proprioceptive 
components. 

In a different type of propriocep- 
tive study, Baxter and Travis (5) 
measured the vestibular RT’s of 31 
Ss to rotary motion of the body. The 
Ss were blindfolded, seated in a con- 
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stant-speed revolving chair, and in- 
structed to press a telegraph key 
upon detecting a change in motion. 
When the chair was moved from a 
stationary position, a mean RT of 
0.52 sec. was obtained; when the 
chair was in motion and the direction 
of motion was changed, a mean RT 
of 0.72 sec. was obtained. From this 
highly significant difference Baxter 
and Travis concluded that the RT to 
perception of motion from rest is 
faster than the RT to perception of 
change in direction of motion. 

The possible variation of RT with 
the sense modality used for stimula- 
tion is a question which has not been 
answered by the studies reviewed. 
As noted above, genuine comparisons 
require the use of common scales and 
such scales have not been employed. 
One possibility presently available is 
to determine the RT’s on a statistical 
or probability basis and make com- 
parisons in terms of a probability of 
RT scale. The first step is to deter- 
mine empirically for each sensory mo- 
dality the relationship between RT 
and the intensity dimension used for 
that modality, the function 
P(RT)=f(1). This relationship is 
presumably sigmoid. ‘Time of reac- 
tion (RT) can now be determined as 
a function of the probability of reac- 
tion for each case, i.e., the function, 
RT =g[P(RT)] can now be obtained. 
Since P(RT) is common for all mo- 
dalities, this function furnishes a le- 
gitimate basis of comparison within 
the range, 0< P< 1.00. 


1.€., 


RT as a Function of the Number of 
Sense Organs Stimulated 


No recent work has been done on 
mono- versus bisensory stimulation. 
As indicated in previous reviews Pof- 
fenberger (121) reported the RT to 
light about 0.015 sec. faster for each 
of the three Ss he used when both 
eyes were stimulated than when only 
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one was stimulated. This is hardly 
conclusive considering the size of his 
sample and the likely error of meas- 
urement. Similarly, Bliss (9) found 
the RT slightly shorter for binaural 
than for monaural stimulation. More 
recently, Smith (136) found faster 
RT’s to the apparent movement of 
objects when viewed  binocularly 
than when viewed monocularly. 

Since both visual and auditory phe- 
nomena usually show differences ac- 
cording to whether the stimulation is 
mono- or bisensory, it is reasonable 
that RT’s should show corresponding 
differences. The high expectation of 
these differences is probably the rea- 
son why experimenters have been so 
little motivated to provide demon- 
strations of them. This is unfortu- 
nate because neither Poffenberger’s 
data nor those of Bliss should be con- 
sidered reliable enough to be suffi- 
cient. 

Simultaneous presentation of stim- 
uli to different senses has also been 
studied. Todd (146) presented light, 
sound, and electric shock singly and 
in simultaneous combinations and 
measured the speed of simple reac- 
tion té each. Combined stimuli in 
every case elicited faster RT’s than 
the individual stimuli making up the 
combination. The RT to combined 
sound and light, for example, was not 
only faster than to light alone but 
also faster than to sound alone. The 
shortest RT’s were to the coinbina- 
tion of all three types of stimulus. 
On the other hand, successive stimula- 
tion of different sense organs pro- 
duced longer RT’s than did stimula- 
tion of single sense organs. 


RT as a Function of Number of Re- 
ceptors Stimulated 


According to neurological princi- 
ples of summation, it would be ex- 
pected that the greater the number of 
receptors stimulated, the shorter the 
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latent period and, consequently, the 
shorter the time of reaction. There 
are two studies which support this 
hypothesis. Older data from Froe- 
berg (55) provide some support in the 
visual case. These data show that, as 
the retinal area stimulated is in- 
creased from three to 48 sq. mm., RT 
decreases from 0.195 sec. to 0.180 sec., 
the function appearing to be nega- 
tively accelerated and still decreasing 
at 48 sq. mm. Wright (162) reported 
a similar type of phenomenon for 
thermal RT’s. 


RT as a Function of the Location of 
the Stimulation in the Visual Field 
The visual RT varies with the por- 
tion of the visual field stimulated, ac- 
cording to Poffenberger (121). This 
investigator stimulated at 3°, 10°, 
30°, and 45° away from the fovea and 
measured the increase in length of 
RT over the RT obtained from foveal 
stimulation. He found that RT in- 


creased in the temporal periphery 


from about 0.004 sec. at 3° to about 
0.024 sec. at 45°, and in the nasal pe- 
riphery from about 0.004 sec. to 
about 0.015 sec. [xcept for stimula- 
tion at 3°, increases in RT were con- 
sistently greater for temporal as com- 
pared to nasal stimulation. 
Poffenberger’s data suggest that 
RT is positively correlated with abil- 
ity to perceive shape since shape per- 
ception is greatest in the foveal area 
and decreases toward the periphery. 
RT seems to be correlated also with 
visual acuity (reading of numbers, 
letters, etc.) since this too decreases 
with distance away from the fovea 
and is greater in the nasal half. 
These relationships, although not re- 
cently confirmed, present some very 
interesting possibilities for the field of 
visual measurement and_ suggest, 
among other things, speed-of-seeing 
techniques for the testing of visual 
acuity. Such techniques have had 
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some use in the measurement of acu- 
ity as related to the amount of illumi- 
nation (26, 45, 96). 

Longer RT’s with stimulation in 
the peripheral area would not be ex- 
pected in the dark-adapted eye, pe- 
ripheral sensitivity to weak light be- 
ing greater under this condition. 
Data relevant to this last hypothesis 
were obtained by Lemmon and Gei- 
singer (94) who measured the RT’s of 
14 Ss at the fovea and 45° away. 
Under light-adapted conditions they 
found the RT significantly longer in 
the periphery, which supports Pof- 
fenberger’s (121) results. When the 
eye was dark-adapted, they found the 
average RT of their Ss slightly shorter 
in the periphery, which is in accord 
with the hypothesis. This result, 
however, was not statistically signifi- 
cant. 


RT as a Function of the Intensity of 
the Stimulus 


Considerable research and_ theo- 
retical effort have been expended on 
the relationship between RT and 
stimulus intensity. Early studies (7, 
20, 26, 45, 55, 56) all agree that the 
visual RT becomes shorter as the in- 
tensity of light is increased. More re- 
cent investigations (32, 96, 137, 138) 
concur. In spite of earlier controver- 
sies, there is little doubt that the re- 
lationship is a nonlinear one, not only 
in the case of the visual RT but also 
for auditory (24, 25, 118), gustatory 
(118), thermal (162), and pain (35, 
73, 120) RT’s. Attempts have been 
made to fit the intensity data into 
mathematical, theoretical frame- 
works, with exponential, hyperbolic, 
and parabolic functions all being used 
more or less successfully on the same 
sets of data (78, 91, 118, 124). 

In all the intensity studies cited, the 
intensity of the stimulus was varied 
and the speed of reaction measured 
when the receptor was in a ‘‘normal” 
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condition. In a related, but some- 
what different type of study, Hov- 
land (76) carefully investigated the 
effect on the RT to a test stimulus of 
250 foot-candles of having the eye 
previously adapted to lights ranging 
from zero to 200 foot-candles. As 
might be expected, RT became shorter 
as the difference between adaptation 
brightness and stimulus brightness in- 
creased. This result is not altogether 
clear, however, since Lemmon and 
Geisinger (94), who also used a very 
bright test stimulus, found shorter 
RT’s with the light-adapted than 
with the dark-adapted eye. 

In addition to varying the intensity 
of the stimulus or of the adapting 
stimulus, it is also possible to vary the 
magnitude of change in the intensity 
of on-going stimulation. The RT has 
been studied in this way only in vi- 
sion. Steinman (137) found that the 
RT became shorter as the relative 
magnitude of the change in intensity 
was increased. The relationship held 
only up to a limit, however, after 
which the RT began to increase 
again. This suggests that the func- 
tion is not monotonic, but rather has 
an optimum at some _ moderate 
amount of change in intensity. If this 
conclusion is supported, it may pro- 
vide an explanation for the discrep- 
ancy between Hovland’s (76) finding 
a consistent decrease of visual RT 
with greater differences between adap- 
tation intensity and test stimulus in- 
tensity and the opposing result ob- 
tained by Lemmon and Geisinger 
(94); i.e., the change in stimulus in- 
tensity in the latter study may have 
been at or beyond that point in the 
function where RT begins to become 
longer. Some support for this hy- 
pothesis is to. be found in a study re- 
ported by Johnson (81). In this ex- 
periment Johnson darkened one half 
of a photometric field by about 4.6 
per cent and compared the RT’s 
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when the surround was 2.25 times as 
bright as the test field, 0.75 times as 
bright as the test field, or too dark to 
be measured. The test field itself had 
a brightness of 7.8 millilamberts and 
was of foveal dimensions. Johnson re- 
ports that the slowest RT was that 
elicited under the darkest condition, 
the next slowest under the brightest 
condition, and the fastest RT was ob- 
tained under the moderately bright 
surround. All differences were statis- 
tically significant. These results, 
along with those of Steinman, indi- 
cate the likelihood of an optimum in- 
tensity change and again suggest an 
explanation for the otherwise contra- 
dictory results of Lemmon and Gei- 
singer. 

RT’s have been used effectively to 
study the effect of illumination on 
visual acuity. Luckiesh (96, p. 131) 
and Cobb (26) both found that speed 
of vision (RT) increases rapidly with 
increases in illumination up to about 
18 to 20 foot-lamberts, after which 
further increases in illumination have 
no significant effect. Data from Fer- 
ree and Rand (45) indicate that speed 
of seeing is also a function of size of 
test object. In this study the limit of 
speed reached a maximum at approx- 
imately 25 foot-candles for relatively 
large test objects (3, 4.2, and 5.2 min- 
utes of visual angle) and at approxi- 
mately 45 foot-candles for relatively 
small test objects (1 and 2 minutes of 
visual angle). 


RT as an Index or Measure of Sensa- 
tion 


The study of the effect of changes 
in magnitude of stimulus intensity on 
RT suggests the possibility of apply- 
ing RT measures to psychophysical 
problems. The use of choice reaction 
times in what has been called the 
method of judgment time (17, 40, 
144) is not new, of course. Although 
the use of the RT as a psychophysical 
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measure has always been implicit in 
the design of experiments involving 
v* al and auditory thresholds, it has 
only recently had serious employ- 
ment in this regard. 

Steinman (137) studied the ade- 
quacy of the RT to change in bright- 
ness as a psychophysical method. As 
discussed above, he found that RT 
decreased as a (seemingly hyper- 
bolic) function of the magnitude of 
change. With a constant stimulus- 
ratio this relationship was maintained 
up to the higher intensity levels where 
a reversal occurred. Although he at- 
tributed this reversal to an adapta- 
tion effect, other hypotheses are pos- 
sible, as was indicated in the discus- 
sion of the effect of intensity. 

Steinman (137, 138) also observed 
that the RT was faster to a decre- 
mental change in magnitude than it 
was for an objectively equal incre- 
ment of change. This places a restric- 
tion on the method, but it is a restric- 
tion not without parallel in the 


standard psychophysical techniques. 
In any case, Steinman was able to 
plot RT functions which were in close 
agreement with similar functions ob- 


tained by more customary proce- 
dures, and for this reason he con- 
cluded that the method is adequate 
for securing equal perceptibility con- 
tours, threshold measurements, etc. 

Other similar studies have been 
done, most of them quite recently. 
Galifret and Piéron (57) were also 
successful in obtaining visual func- 
tions based on differences among 
RT’s. Chocholle (25) discusses the 
problem relevant to the psychophysi- 
ology of hearing; Wertheimer (156) 
suggests using the RT for obtaining 
radiant heat pain thresholds. Essen- 
tially this has been done both for the 
determination of the radiant heat 
pain threshold (61, 139) and the radi- 
ant cold pain threshold (35). Wright 
(162), furthermore, has obtained the 
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Weber type of function by using cu- 
taneous RT’s as an index of sensa- 
tions of warmth produced by light 
radiation. 


RT as a Function of the Duration of 
the Stimulus 


It is difficult to see why the dura- 
tion of the stimulus should influence 
the RT to the onset of a suprathresh- 
old stimulus unless some type of sum- 
mation of intensity hypothesis is ad- 
vanced. Nevertheless, there is some 
suggestion in the literature that stim- 
ulus duration does have an effect. 

lroeberg (55) varied visual stimuli 
by equal geometric intervals between 
0.003 sec. and 0.048 sec. Within this 
range he found that the longest dura- 
tions produced the shortest RT’s, the 
function (of the geometric intervals) 
being linear. 

Wells (155) varied the duration 
both of sound and of light stimuli. 
lor an auditory stimulus he used the 
sound of an electric buzzer with dura- 
tions of 0.007, 0.036, 0.051, 0.076, and 
0.106 sec. Two Ss gave 200 responses 
under each duration. The results in- 
dicated that RT was a linear function 
of the logarithm of the duration of 
the stimulus, which is in agreement 
with Froeberg’s visual data. But, al- 
though the form of the relationship 
was the same as that obtained by 
Froeberg, the slope was in the opposite 
direction. To study the effect of 
duration in the visual case, Wells 
used a constant intensity stimulus 
(brightness of 0.12 millilamberts) at 
five durations ranging between 0.012 
and 1.00 sec. In this experiment Ss 
responded to the onset of the light. 
In a second experiment performed 
with the same Ss, response was made 
to the cessation of the light. Five 
durations of light were used again, 
this time ranging between 0.010 and 
1.00 sec. The results differed from 
those of Froeberg in that they indi- 
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cated that there is an optimal dura- 
tion and that this duration varies 
from individual to individual. What- 
ever the individual optimum, RT 
tended to become longer with devi- 
ations from it. The range of optima 
for ten Ss was between 0.025 and 
0.066 sec. However, large variations 
were found not only for the optima 
among Ss, but in the optima between 
stimulus onset and cessation even for 
individual Ss; i.e., the optimum was 
usually not nearly the same for a 
single S under the two conditions. 
Brogden and his students (21, 22, 
62, 63) recently performed a series of 
experiments in which they compared 
the RT to auditory stimuli of fixed 
duration with the RT for response- 
terminated durations. They con- 
cluded that the primary variable is 
stimulus duration and that response 
termination merely acts on this fac- 
tor. However, they also found that 
for longer sound durations (400-2000 
msec.) the RT to the response-termi- 
nated stimulus was slightly, but sig- 
nificantly, shorter than to the fixed 
duration stimulus. For the shorter 
durations (100-200 msec.) there were 
no differences. Scrutiny of their data 
leaves the impression that RT in- 
creased in general as stimulus dura- 
tion was increased from 100 msec. to 
400 msec., and as the duration became 
still longer (up to 2000 msec.) RT de- 
creased again. This is in agreement 
with Wells’s results with visual stim- 
uli, but not with Wells’s auditory 
data or with Froeberg’s visual data. 
In spite of the conflicting results 
obtained, it does seem as though 
there is a relationship between stimu- 
lus duration and RT. ‘The most 
reasonable expectation is that the 
function is asymmetrical in nature, 
falling (RT becoming shorter) rap- 
idly as the duration is lengthened 
from zero to some small time value, 
whereupon it rises more gradually to 
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become asymptotic to some limit. 
The minimum of this curve is itself 
probably some function of stimulus 
intensity and length of foreperiod. 


RT as a Function of the Onset and of 
the Cessation of the Stimulus 


Another feature of the stimulus 
presentation which has occasioned 
some research, but about which little 
conclusive can be said, is the use of 
the onset and of the cessation of the 
stimulus as the signal for response. 
Both Holmes (74) and Jenkins (79) 
report shorter RT’s to the cessation 
of light. On the other hand, Woodrow 
(160) found no differences in speed of 
simple reaction to stimulus onset or 
cessation for either auditory or visual 
stimuli. Wells (155) has shown that 
individual differences are very 
marked here, some Ss reacting more 
quickly to one or the other. Wood- 
worth (161) concludes that there is no 
difference between the two condi- 
tions, but the matter seems far from 
settled. Studies are required which 
control the subjective intensity of 
the stimulation at the time of onset 
and of cessation. The duration of the 
stimulus would appear to be an im- 
portant variable differentially de- 
termining the effectiveness of each 
condition. The readiness of S might 
be expected to be different in ac- 
cordance with the one to which he 
responds. 


CENTRAL AND MOTOR FACTORS 


Cerebral factors have not been 
studied in a way to make them ap- 
plicable to this discussion, although a 
little work been done (135). 
Studies of speed of nerve conduction 
have theoretical significance but do 
not allow for generalization since 
they deal with the application of the 
stimulus directly to the nerve fiber 


and by-pass both sensory and motor 


has 


factors. Certain psychological condi- 
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tions which might be of importance, 
e.g., personality factors (12, 151), the 
influence of incentives and punish- 
ments (80), etc., will not be dis- 
cussed owing to the limited research 
that has been done and the great 
complexities of the results. A few 
topics that might have been included 
here have been singled out for the 
next section, Special Factors. 

Regarding the motor system, most 
of the work that has been done on the 
responding mechanism is irrelevant 
in this context. Studies of the refrac- 
tory phase (e.g., 142) are of interest 
only in the case of successive quickly 
elicited responses (39, 123). Most of 
the relevant studies of this sort in- 
volve more complex types of reaction 
time measures. 


RT as a Function of Age and Sex 


The correlation of age and RT has 
received some attention. Jones (84) 
found an increase in speed of reaction 
to sound in boys ranging from 11 to 
14 years. According to this study no 
further increases should be expected 
beyond age 14. Atwell and Elbel (3), 
however, report continued small in- 
creases in speed up to 17, the oldest 
age used in their study. Bellis (6), 
in a study of ages ranging from 4 to 
60 years, observed a general shorten- 
ing of both visual and auditory RT’s 
until age 30, after which latencies be- 
gan to grow longer. Even at 60, 
however, he found that RT is still 
faster than it is at 10. Miles (107), 
using three kinds of response (finger 
pressing, finger lifting, and right-foot 
lifting), tested 100 adults between 25 
and 87 years of age and found low 
(0.25 to 0.55) but significant positive 
correlations between age and speed of 
reaction. Elliot and Louttit (38) also 
report a low positive correlation. It 
would appear, therefore, that RT 
does covary with age. ‘‘Years old,” 
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however, may not be the best meas- 
ure of the age factor. 

Regarding sex differences, Elliot 
and Louttit (38) in an investigation 
of the braking reaction of men and 
women in automobiles reported that 
men react significantly more quickly. 
Bellis’ (6) data, based on both audi- 
tory and visual stimuli, also favor 
males, especially in the age periods of 
4-10 and 40-60. Seashore and Sea- 
shore (132), in studying the speed of 
various muscular responses (right 
and left hands, right and left feet, 
jaws), found men significantly faster, 
especially after practice. The weight 
of the evidence indicates that a sex 
difference favoring men does exist, 
although this conclusion is hardly 
likely to end a perennial controversy. 


RT as a Function of Preparatory Set 


It is reasonable that RT will de- 
pend on the degree to which S is 
ready to respond. The use of a pre- 
paratory signal has been shown to 
yield faster RT’s than the omission 
of such a signal (163) or the unex- 
pected presentation of a second sig- 
nal requiring a second reaction (123). 
Consequently, most experiments use 
a ready signal. 

This factor of readiness or set seems 
to depend, among other things, on 
the length of time between the warn- 
ing or ready signal and the stimulus 
to which the response is made, what 
is known as the foreperiod of reaction. 
Breitweiser (11) found definite indi- 
vidual differences in the length of the 
optimum foreperiod and reported a 
range of optima between 1.0 and 4.0 
sec. Telford (142), however, taking 
repeated measurements of 29 Ss, ob- 
tained conflicting results when he 
found that the average RT increased 
systematically from an optimum of 
1.0 sec. to at least 4.0 sec. Telford's 
data also indicated that as the fore- 
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period is reduced from the 1.0 sec. 
optimum to at least 0.5 sec., RT de- 
teriorates markedly. 

The study most frequently quoted 
with regard to the foreperiod is that 
of Woodrow (159). According to this 
study a 2.0-sec. foreperiod is opti- 
mum. In spite of the wide acceptance 
of this figure, there is a question as to 
the significance of Woodrow’s results 
since the data were obtained from 
only three Ss and, as they are re- 
ported, do not allow for an estimation 
of the standard errors of the means. 
Freeman and Kendall (54) estimated 
that if Woodrow’s standard errors 
(which were not reported) were of the 
same order as those obtained in their 
study, which used four Ss, the differ- 
ence between the 2-sec. and 8-sec. 
intervals obtained by Woodrow 


would have fallen between the 5 and 
10 per cent levels of confidence. Ordi- 
narily this would be sufficient to ac- 
cept the null hypothesis. 

Early studies (85, 


158) demon- 
strated that preparatory sets are 
primarily muscular. Livingston (95) 
has shown that the amount of muscu- 
lar tension varies during the fore- 
period. Freeman (52, 53) and Free- 
man and Kendall (54) have investi- 
gated the influence of the amount, 
the locus, and the time of induction of 
muscular tension during the fore- 
period on the RT. Under conditions 
of heavy load (large induced muscu- 
lar tension), a longer foreperiod was 
found to be optimum than under 
light-load conditions. The locus of 
the tension was also found to be a 
significant factor in determining the 
optimum preparatory interval. Per- 
haps their most interesting finding 
was that the optimum interval varied 
with the length of time prior to the 
response that the tension was in- 
duced. When the amount, locus, and 
time of induction of muscular tension 
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are all considered together, they (54) 
found that the optimum foreperiod 
ranged between 4 and 8 sec., depend- 
ing on individual differences. As im- 
plied above, there is reason to believe 
that Woodrow’'s obtained optimum 
actually may be expressed best as a 
range between 2 and 8 sec. 

Another factor thought to influ- 
ence the readiness of the S to respond 
is whether he is set to respond to the 
stimulus (‘‘sensory attitude’’) or 
whether he concentrates on the re- 
sponse (‘‘muscular attitude’). Al- 
though the weight of the evidence ap- 
pears to favor the latter, no con- 
trolled studies have been performed 
since Woodworth’s (161) review. We 
are forced, therefore, to rest with the 
older, and for the most part less well- 
controlled, studies. These are thor- 
oughly discussed by Woodworth. 

The effect of instructions consti- 
tutes another great unknown which 
presumably determines the readiness 
of the Sto respond. Perhaps the most 
serious obstacle to overcome in in- 
vestigations of this factor is not the 
ambiguity of language but an in- 
ability to know and tocontrol S's self- 
instructions. Some promising work 
has been done, however, in which in- 
structions were varied. Davis (33) 
compared the effect of instructions to 
respond with instructions to not-re- 
spond. Instructions to respond re- 
sulted in higher prestimulus tension 
levels in the responding arm, as 
measured by action potentials, and 
resulted in faster RT’s. Davis also 
noted that instructions to respond 
were made even more effective by 
using more intense stimulation. This, 
however, would be predicted from the 
relationship between RT and stimu- 
lus intensity and may, therefore, be 
independent of the effects of instruc- 
tions. 

Moore (111) found that instruc- 
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tions have a greater influence on the 
variability of the RT than they do on 
the variability of the speed of move- 
ment of the responding part. When 
Ss were instructed to respond as 
quickly as possible with the fastest 
possible movement, the of 
movement remained practically con- 
stant but the speed of reaction varied 
considerably. 

It is clear that a great many factors 
influence the optimum 
Other variables which should be 
studied in this relation are the in- 
tensity and duration of the stimulus. 
Of these, duration would appear es- 
pecially important since the durations 
of both ready signal and stimulus are 
confounded with the length of the 
foreperiod. No single value seems 
acceptable as the optimum since so 
many conditions are effective. Per- 
haps a more useful concept would be 
a range, the modal point of which 
would shift according sensory 
modality, stimulus intensity and 
duration, nature of muscular tension, 
kind of instructions, etc. Presently 
available data indicate that such a 
range lies between approximately 1.5 
and 8 sec. 


speed 


foreperiod. 


to 


RT as a Function of Body Position 


One question of much interest is 
whether or not the RT varies accord- 
ing to the position of the body. This 
has especial relevance today in con- 
nection with many military and in- 
dustrial problems. Reference to one 
such study has been found. Munnich 
(114) investigated the RT of several 
responses modeled after various as- 
pects of an airplane pilot’s task. 
These RT’s were studied with S in 
six different bodily positions: (a) 
seated normally with the back of the 
chair making a 120° angle with the 
seat; (b) stomach downward; (c) head 
downward; (d) back downward; (e) 
on right side; (f) on left side. Un- 
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fortunately, the report was not avail- 
able at the time of writing and the 
abstract does not describe the differ- 
ences, if any, which were obtained 
between positions. One interesting 
result, however, is described. It was 
found that RT increased in general 
after any change in position, but as 
the new position was maintained the 
RT’s tended to return to the values 
normal for it. The generality of this 
conclusion is offset by the finding 
that some Ss improved their speed of 
reaction even after being changed to 
the most uncomfortable positions. 


RT as a Function of the Responding 
Member 


Of great theoretical and applied 
importance is the question of whether 
the RT varies with the body member 
which responds and with the type of 
motion involved. Regarding the lat- 
ter, most of the responses which have 
been used have consisted of the sim- 
ple release of a telegraph or similar 
key, or, less frequently, the depres- 
sion of such a key. Other types of 
hand motion have also been used and, 
in addition, such other body parts as 
the eye, mouth (both movement of 
the jaws and the verbal response), 
arm, leg, foot, or the entire body. 
Although the types of response are 
usually as simple as possible and the 
methods of measurement usually 
some sort of chronoscopic device, 
both of these vary somewhat from 
one experiment to another. Discus- 
sions of the experimental techniques 
used and of the effects of these tech- 
niques may be found in several places 
(8, 11, 161). Whether the equivocal 
results obtained from studies of this 
type are really due to differences in 
technique is hard to say. 

Woodworth (161), in reviewing 
this problem, presented a number of 
studies in which no differences were 
found between body members. 
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Baxter’s (4) data support these re- 
sults. On the other hand, Féré (44) 
found that the RT for the left hand 
was slower than that for the right, 
and that the sum of the RT’s of each 
hand was larger when S tried to re- 
spond with both hands at once than 
when he moved them successively. 
Cattell (20) also observed that the 
RT for a particular task differs with 
the body member used, at least for 
the wrist, forearm, and_ shoulder. 
Hathaway (66) obtained results indi- 
cating that RT is longer for move- 
ment of the entire arm than it is for 
finger movement. Seashore and Sea- 
shore (132) reported that RT with 
the left hand was slower than with 
the right, and, similarly, the left foot 
was slower than the right foot. They 
also found that speed of reaction of 
the jaws was greater than either the 
hands or feet. Chernikoff and Taylor 
(23) presented data showing that 
when the stimulus is the sudden dis- 
placement of S’s arm, his RT is 
shorter when he stops the movement 
than when he releases a telegraph 
key. Considering the contradictions 
in the various sets of data, it cer- 
tainly seems too early to draw even a 
tentative conclusion about the role 
played, if any, by the kind of re- 
sponding member. It is possible that 
the only real differences are due to 
differences in inertia of the respond- 
ing musculatures. 

Woodworth (161) suggested that 
complex movements produce longer 
RT’s than do more simple ones. Not 
many studies were available to sup- 
port this, but on the basis of those 
few that were, Woodworth made two 
specific hypotheses: (a) that guided 
(aimed) movements have longer R'T’s 
than those made freely; (6) that the 
RT is shorter for the initiation of a 
movement than it is for the stopping 
of it or for the changing of its direc- 
tion. 
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No studies were found bearing di- 
rectly on either of these hypotheses, 
but there are some results which are 
relevant to the general hypothesis 
that RT is somehow related to the 
response movement that follows it. 
Searle and Taylor (129) investigated 
the RT of corrective tracking move- 
ments made with a small knob to the 
displacement of a visual stimulus and 
found that this RT was not affected 
by the amount of knob movement re- 
quired to make a correction. Brown 
and Slater-Hammel (13) reported 
that the RT involved in making dis- 
crete arm movements in the hori- 
zontal plane is independent of the 
length and direction of the move- 
ment. Henry (71) obtained data 
which indicate that RT’s and move- 
ment times are not related. Except 
for the possible effect of the prepara- 
tory set, it is difficult to see why RT 
and consequent movement should be 
related. The results available indi- 
cate that they are not. 


Other Central-Motor Factors 


Studies of extraneous tension dur- 


ing the occurrence of the response ap- 
pear to be of only incidental interest 


here. Action potentials taken from 
muscles not involved in the response 
are not related to the speed of re- 
action, according to Meyer (105, 
106). Daniel (30), however, con- 
sidered Meyer’s conclusion not war- 
ranted by his data, and Henderson 
(69) reported a relationship between 
speed of reaction of one arm and ac- 
tion potentials taken from the non- 
participating arm. 

Of greater interest in this context is 
the finding that lowered muscular 
tension produces longer RT's (86, 87, 
147). ‘Lhis finding appears to be re- 
lated to the problem of the prepara- 
tory set and to the effects of practice. 
A few writers (e.g., 69) have reported 
increased speeds with practice. It is 
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possible that these increases may be 
due, not to the effect of learning on 
the RT itself, but to the effect of 
learning on the preparatory interval. 
This latter effect may consist of the 
learning of an optimal anticipatory 
muscular tension. 

The RT exhibits considerable vari- 
ability among individuals (41, 60, 92, 
161) but is, nevertheless, reasonably 
consistent. Reported reliability co- 
efficients range between 0.83 and 0.92 
(41, 42, 59, 115, 130, 131). RT meas- 
ures also show considerable varia- 
bility among experimental studies. 
Both types of variability may be due, 
in part, to the points on the tremor 
cycle at which the stimulus is pre- 
sented (145). In spite of variability, 
relatively high —intercorrelations 
among different kinds of RT tests 
have been obtained (42), which sug- 
gests a common factor present in the 
various tests, and, according to Sea- 
shore, Buxton, and McCollom (130), 
such a factor can be analyzed. 
Further evidence supporting the no- 
tion of an RT factor comes from 
studies showing no relationship be- 
tween RT and intelligence (42, 133), 
substitution (133), card sorting (133), 
discrimination reaction time (42, 
130), pursuit rotor performance (42, 
130), and little or no relationship to 
tapping tests (130). Slocombe and 
Brakeman (134) have also suggested 
that RT measures yield a group fac- 
tor and, in addition, that this factor 
may be used to discriminate, at least 
among motormen, between good and 
poor accident risks. 


SPECIAL FACTORS 


Certain conditions, such as expo- 
sure to extreme climatic conditions, 
the effects of drugs, prolonged effort, 
starvation, deprivation of sleep for 
long periods, etc., are singled out here 
because of the unique interest which 
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they hold for many investigators. 
Some, if not all, of these could have 
been included in the previous section. 


RT as a Function of Prolonged Readi- 
ness 


Mackworth (102) in a series of 
studies of military personnel under 
conditions of prolonged vigilance 
found that the RT to the double- 
jumps of a clock hand _ increased 
sharply after one-half hour of watch- 
ing. This increase could be prevented 
by the use of Benzedrine or by in- 
forming S of the results of the test. 

In a related study Kennedy and 
Travis (87) measured the action po- 
tentials and the RT to combined 
light and sound stimuli under long 
monotonous conditions. Their re- 
sults indicate that the frequency of 
action potentials decreases and the 
KT to irregularly presented stimula- 
tion becomes longer as the testing 
period is lengthened. After falling 
asleep, one stimulus presentation was 
sufficient to awaken S, the RT on this 
occasion being considerably longer, 
as might be expected. However, the 
RT approached its normal level 
rapidly with subsequent presenta- 
tions. 


RT as a Function of Certain Common 
Drugs 


The RT has been used as the “I 
told you so” of all those who would 
restrict the use of the common drugs. 
In spite of this, the effects of these 
drugs on RT are not always clear 
when the conditions of the experi- 
ment are carefully considered. Some 
of the experimental problems are dis- 
cussed by Hull (77) and more re- 
cently by Gray and Trowbridge (59) 
and by Miller (109). No real attempt 
will be made here to evaluate this 
type of effect but merely to point out 
a few representative papers. 
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With respect to coffee drinking, 
Hawk (68) and Gilliland and Nelson 
(58) claimed lengthened RT's. On 
the other hand, there are studies such 
as that of Thornton et al. (143) in 
which no effect was claimed. Ciga- 
rette smoking appears to decrease the 
variability of visual RT’s according 
to both Hull (77) and Fay (43), but 
has no other reliable effect. Alco- 
hol, on the other hand, both increases 
variability and lengthens visual (108, 
150) and auditory (150) RT's. Benzed- 
rine appears to have little or no ef- 
fect on the auditory RT (143). Mack- 
worth (102), however, did find that 
Benzedrine tended to offset decre- 
ments produced by prolonged vigi- 
lance. Aspirin has no effect on either 
visual or auditory RT’s (31). A 30 
per cent saturation of carbon mon- 
oxide is required to produce an in- 
crease in visual RT (49). Finally, 
morphine has the effect of first 
shortening and then lengthening RT 
except when taken in large doses, in 
which case only the latter effect oc- 
curs (101). 


RT as a Function of Temperature 


A number of studies (e.g., 75, 110, 
157) have been done to determine the 
effects of climatic stress, temperature 
in particular, on the RT. The general 
result of these studies is that ambient 
temperatures between a range of 
—50°F. and 117°F. have little or no 
effect on either RT or more complex 
reaction times. This conclusion was 
reached by Forlano, Barmack, and 
Coakley (50) after a careful review of 
the effects of ambient and body tem- 
peratures oi. RT. Most of the studies 
available for evaluation, however, 
are distinguished by the degree with 
which several main variables are con- 
founded in one experiment, and con- 
sequently are given to difficulty of 
interpretation. Such a conclusion, 
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therefore, should not be accepted as 
firmly established. 

RT’s have also had a little atten- 
tion with regard to skin tempera- 
tures. Craik and Macpherson (29) 
report that cooling of the hand with 
which the response is made may in- 
crease RT by 10-15 per cent. This 
conclusion is not reasonable on the 
basis of their study since an increase 
of this much turns out to be an in- 
crease of 0.02 to 0.06 sec., a change 
which has little significance in terms 
of the likely error of measurement 
and the size of the sample (two Ss). 

A few RT studies have been done 
with body temperature and/or time 
of day as the independent variable. 
In general, these studies (89, 90, 104) 
suggest that RT exhibits a slight 
diurnal variation, but with large in- 
dividual differences. The data may 
also be interpreted to indicate that 
RT is a function of body temperature 
and is only spuriously correlated with 
time of day (50). 


Effects of Sleep Conditions on RT 


Most of the studies in which the 
stimulus for the RT has been pre- 
sented during sleep have been related 
to the problem of determining the on- 
set or the depth of sleep. Since the 
detection of both of these conditions 
still lacks other independent criteria, 
studies of this sort have little validity 
with respect to generalizations about 
the effect of sleeping on the RT. A 
discussion of this problem may be 
found in Kleitman (88). 

Mullin and Kleitman (113) used a 
criterion of sleep onset which was in- 
dependent of the RT and then in- 
vestigated the change in a verbal, 
auditory RT for periods of time fol- 
lowing onset. In this experiment, on- 
set of sleep was considered to be 
established when S released a piece 
of paper which he held in his hand. 
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Using both normal and feebleminded 
adults and normal children as Ss, 
Mullin and Kleitman found a slow 
increase in the verbal RT for the first 
25 min. after onset, followed by a 
stable period of long RT’s, and then 
by a third period of rapid shortening 
of the RT. This cycle, which was 
sigmoid in nature, was completed 
during the first hour after onset and 
did not reappear during the rest of 
the night. 

Considerably more work has been 
done concerning the effect of lack of 
sleep on RT. Although most of the 
studies concerned — primarily 
with more complex reaction times, 
enough have been done with the RT 
to allow some evaluation. 

As long ago as 1896 Patrick and 
Gilbert (116) tested the auditory and 
visual R'T’s of three Ss deprived of 
sleep for 90 hours and reported a 
marked slowing of speed. Later, 
Robinson and Herrman (126), in a 


were 


more rigorous experiment, found that 
experimental insomnia produced no 


consistent effect on RT. With the 
exception of one or two studies re- 
viewed by Kleitman (88), this latter 
result has marked the literature ever 
since, not only with respect to RT 
measures but practically all measures 
taken. Part of the difficulty might be 
blamed on the small samples usually 
used. On the other hand, large sam- 
ples are administratively extremely 
difficult to achieve in this type of in- 
vestigation. Lee and Kleitman (93), 
for example, tested the RT of only 
one S following 114 hours of sleep 
deprivation. This one S showed no 
effect. Cooperman, Mullin, and Kleit- 
man (28) report no change in audi- 
tory RT for six Ss after 60 hours of 
privation, as did Tyler (149) after 
24-114 hours of sleep loss. 

Edwards (36) reported a study in- 
volving relatively large samples. He 
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compared the auditory RT of 17 Ss 
deprived of sleep for 100 hours with 
that of ten control Ss. His data sup- 
port the studies already cited since 
he found no significant differences be- 
tween the groups. It seems, therefore, 
that although extremely small sam- 
ples may contribute to the variability 
of results, they cannot be considered 
the major reason for the failure of 
more recent studies to confirm the 
results of Patrick and Gilbert. 

Most writers, when discussing the 
general failure to show that sleep loss 
influences RT, invoke ‘‘compensa- 
tion” on the part of S as an explana- 
tory concept. What is usually meant 
is that S achieves the same perform- 
ance under stress as he does when not 
under stress by expending greater ef- 
fort. Granting the looseness of this 
argument, the possibility of testing it 
appears available. If one is willing to 
accept greater muscular tension dur- 
ing the foreperiod and during the RT 
interval as a measure of greater effort, 
it should be relatively easy to deter- 
mine by measuring tension during 
these intervals if compensation is 
really a useful concept. 


Other Special Effects 


One experiment was found in which 
the effect on the RT of radial acceler- 
ation was studied. Canfield, Comrey, 
and Wilson (16) investigated the ef- 
fects of positive acceleration forces of 
1, 3, and 5 g on the RT’s to light and 
also to sound. Both kinds of RT were 
found to lengthen significantly with 
increased acceleration. Moreover, 
the slowing of reaction observed was 
not due to decrements in sensory 
functioning as the Ss were neither 
“blacked out” nor “‘greyed out” and, 
in addition, the Ss did not notice any 
change in sensory functioning. 

In a different type of study, Tuttle 
et al. (148) reported that omission 
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of breakfast increased the visual RT 
of their five Ss. In a more careful nu- 
trition study involving restriction of 
vitamin B, BroZzek et al. (12) found 
that partial restriction of vitamin B 
intake for 23 days had no effect on 
the auditory RT of their eight Ss. 
Only prolonged and severe depriva- 
tion produced significant decrements. 

McFarland (97, 98, 99, 100) has 
shown that RT is affected by altitude 
(anoxia), but not significantly before 
at least 20,000 ft. Variability of RT, 
however, begins to increase at 2000— 
3000 ft. before the average RT shows 
a decrement. McFarland (97) has 
also reported that people who live on 
mountains at extreme altitudes have 
longer and more variable RT’s than 
people living at sea level in the same 
region. 


SUMMARY AND CONCLUSIONS 


Factors other than those discussed 
would appear to be important, but 
have not been studied in relation to 
the RT. For example, it might be ex- 
pected that RT would decrease as a 
function of speed of travel or stimula- 
tion across the retina or the skin. The 
condition of the receptor and of the 
responding member are still among 
the conditions which have received 
insufficient attention. In spite of a 
long history of research, the effect of 
the sensory system is still an open 
question. 

Many of our notions about the RT 
depend upon what are now classical 
studies, studies which did not have 
the advantage of modern statistical 
procedures. The question of mono- 
versus bisensory stimulation falls in 
this class. Research is also required 
to ascertain the effect of stimulus 
duration and the interaction be- 
tween duration and intensity. Re- 
lated to this is the problem of area or 
number of receptors stimulated, and 
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this too is in need of further experi- 
mental investigation. 

On the positive side, intensity 
functions are relatively well estab- 
lished. The last 20 years have yielded 
a considerable amount of information 
about the effects of age and sex. They 
have also produced more definitive 
information about the role of the re- 
sponding member, and about the 
factors involved in the foreperiod, al- 
though a great deal more research 
must yet be performed before the 
latter is really well understood. 

The incentive to study the effects 
of sleep loss, drugs, temperature, alti- 
tude, acceleration, vigilance, etc. to a 
large extent has come from applied 
areas. Few, if any, safe generaliza- 
tions are yet available. However, 
these topics will undoubtedly con- 
tinue to receive a great deal of atten- 
tion since many of them constitute 
important military problems. 

All things considered, the last two 
decades have been quite productive, 
not of mathematically expressed em- 


‘pirical laws, but of useful nonmathe- 


matical generalizations and of clearer 
definition of the problems than was 
available before. The present status 
of the RT study may best be evalu- 
ated in terms of the generalizations 
which it has yielded. In the opinion 
of the writer the following generaliza- 
tions appear to have been reason- 
ably well established. 

1. There is a positive correlation 
between the visual and the auditory 
RT. 


2. Simultaneous stimulation § of 


more than one sense modality pro- 
duces faster RT’s than stimulation of 
just one. On the other hand, succes- 


sive stimulation of different senses 
produces slower RT’s than stimula- 
tion of a single sensory channel. 

3. For visual and thermal RT’s the 
greater the extent of the stimulus in 
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space, i.e. the greater the number of 
receptors stimulated, the faster the 
speed of reaction up to some limit. 

4. Under daylight or illuminated 
conditions the visual RT becomes 
longer the greater the distance of 
stimulation from the fovea. 

5. In the case of each receptor sys- 
tem, RT is a negatively accelerated 
decreasing function of intensity up to 
some maximum intensity value after 
which RT either becomes suddenly 
lengthened, the function at this point 
being discontinuous, or asymptotic to 
a physiological limit. 

6. RT is a slowly falling growth 
function of chronological age until 
about 30 years after which it is a 
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slowly rising function. 

7. In general the RT of the human 
male is faster than that of the female. 

8. The optimum foreperiod of RT 
may be thought of as lying in a range 
between approximately 1.5 and 8.0 
sec. Its position in this range is de- 
termined by a large number of factors 
including the duration and intensity 
of the warning signal and of the stim- 
ulus, and the amount, locus, and time 
of production of muscular tension. 

9. RT is not related to the length, 
direction, or speed of movement of 
the responding member. 

10. Under vigilance conditions, the 
longer the period during which S 
must respond, the longer the RT. 
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The purpose of this article is to il- 
lustrate how the application of tradi- 
tional, systematic, rather than repre- 
sentative, experimental design to 
problems in clinical psychology re- 
sults in unjustified conclusions.! Five 
examples, all drawn from attempts to 
discover the effect of the examiner on 


the subjects’ responses, are presented. 


that 
the 


will be shown 
justified conclusions regarding 
problems being investigated could 
have been drawn if representative 
rather than systematic design had 
been used. ‘The presentation is in- 
tended to be illustrative rather than 
exhaustive. 

Consider first the simplest form of 
systematic design—-the classical one- 
variable design. Both Brunswik (3, 
p. 8) and Fisher (11, p. 88) point out 
that this design is inherited from 
classical physics and both agree that 


In each case it 


revision of this procedure is neces- 
sary. bisher, for example, remarks: 


In expositions of the scientific use of ex- 
perimentation it is frequent to find an exces- 

1 The two types of design are juxtaposed 
here in conformity with a distinction estab- 
lished by Brunswik (3). In the sense in which 
he uses the terms, “representative design’’ 
refers to the transfer of the principles “of 
sampling statistics from the subjects of a 
psychological investigation to the objects or 
situations which constitute the stimuli in the 
investigation. The arbitrary orderliness with 
which these external (independent) variables 
are customarily handled is summarized by 
Brunswik under the opposite heading of ‘‘sys- 
tematic design,’ and Fisher's factorial design 
(11) is presented as a relatively recent and 
relatively complex example. Fisher has also 
used the term “systematic” in a 
albeit somewhat casual, manner (12). 
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similar, 


sive stress laid on the importance of varying 
the essential conditions only one at a time... . 
This ideal doctrine seems to be more nearly 
related to expositions of elementary physical 
theory than to laboratory practice in any 
branch of research. In experiments merely 
designed to illustrate or demonstrate simple 
laws, connecting cause and effect, the relation- 
ships of which with the laws relating to other 
causes are already known, it provides a means 
by which the student may apprehend the re- 
lationship, with which he is to familiarize 
himself, in as simple a manner as possible. By 
contrast, in the state of knowledge or ig- 
norance in which genuine research, intended 
to advance knowledge, has to be carried on, 
this simple formula is not very helpful (11, 
p. 88). 


Brunswik and Fisher agree con- 
cerning the disadvantages of classical 
experimental design, but they differ 
as to the remedy. Their differences 
lie not so much in the general nature 
of the reform needed as in the extent 
of the reform Thus, although 
lisher’s dissatisfaction led him to de- 
velop the multivariate analysis of 
variance and related techniques, 
Brunswik’s efforts have resulted in a 
more thorough and more radical re- 
vision of experimental methodology. 
For, although Fisher urged multi- 
variation of conditions in the experi- 
ment (wherein results are obtained), 
thereby approaching one of the con- 
ditions permitting the application of 
results, Brunswik urges that in order 
to eliminate the traditional artificial- 
ity in the choice and manner of varia- 
tion of the experimental variables, 
the the experiment 
represent statistically the universe of 
situations toward which one wishes to 
generalize. 


conditions of 
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In suggesting that the logic of 
sampling theory (which psychologists 
have long applied to populations of 
subjects) be applied to stimulus situa- 
tions, Brunswik brings experimental 
methodology in line with the modern 
statistical approach to the problem 
of inductive inference. For example, 
“it is clear that the statistical signifi- 
cance of a result may be investigated 
in both directions” (3, p. 36). Situa- 
tional (or ‘‘ecological’’) generality of 
results, therefore, is as much a chal- 
lenge to statistical scrutiny as the 
subject-populational generality of re- 
sults. As Brunswik points out, not 
only should we be concerned with the 
number of stimulus variables in- 
cluded in the experiment, but we 
must also consider the manner of 
variation of the stimulus variables and 
their covariation among one another, a 
problem which Fisher, in his concern 
with the mathematical problems in- 
volved in increasing the number of 
variables, did not consider as fully 
as psychologists might wish. 

The above is an extremely cursory 
description of the fundamental no- 
tion of representative design. ‘The 
examples from clinical psychology 
presented later, however, will further 
clarify its meaning. kor a complete 
exposition of representative design, 
the reader is referred to Brunswik's 
monograph (3). From the field of 
academic psychology—notably from 
the perceptual constancies, depth 
perception, gestalt problems and il- 
lusions, and social perception—the 
reader may find concrete examples of 
representatively designed experi- 
ments and ecological surveys in (2; 3, 
pp. 24-38, 41-52; 6; 9). The general 
basis for representative design as 
given by the probabilistic nature of 
behavioral adjustment is presented 
by Brunswik in (1). Further discus- 
sion of representative design and of 
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its place in the historical development 
of psychology may be found in (5). 
An analogy between the discovery, 
on the part of relativity physics, of 
the confinement of traditional physi- 
cal laws to a limited universe of con- 
ditions, on the one hand, and the con- 
siderations in psychology that have 
led to the establishment of represen- 


tative design, on the other, has been 
pointed out by Hammond (16). Ina 
note to this analogy, Brunswik (4) 
has endorsed the writer’s interpreta- 


tion that in spite of the apparent 
in the first case, 
in the second, the 
major problem in both cases is the 


stress on ‘‘theory, 
and on “design,” 
same, that is, “generalization.” 

Another paper by Hammond (15) 
application of the 
principles of representative design to 
certain generalization problems fre- 
quently mismanaged in current social 
and clinical psychology. 
endeavored to 


constitutes an 


This paper 
criticize a concrete 
example of a research project, an in- 
terview study by Robinson and 
Rohde (21). In this study the sub- 
jects had been properly sampled but 
the sampling of the interviewers had 
been ignored; yet the 
“‘sionificance’”’ of the 
results were extended to both the 
subject and the interviewer popula- 
tions. The point made by the present 
writer in criticism of this report was 
that. the interviewers should have 
been “objects,” that 1s, 
as parts of the “situations,” and thus 


conclusions 
concerning the 


treated as 


under the rules of representative de- 
sign should have been sampled in the 
same manner as were the subjects 
proper; or else the generalizations 
should have been limited to the sub- 
ject population.’ 


2 In pointing out the wide discrepancies be- 
tween the large numbers of “judges” (re- 
sponders or subjects proper) and the small 
numbers of ‘‘social objects’ (subjects func- 
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In the present paper we wish to 
extend our criticism of research re- 
ported in the literature to the inap- 
propriate application of systematic 
design to the type of experiment 
which seeks to determine the effect of 
the examiner on the subjects’ re- 
sponses. 


ONE-FACTOR SYSTEMATIC DESIGN 

In the examples discussed below, 
the attempt is made to vary one fac- 
tor, such as the race or sex of the 
examiner, in order to find the effect 
of the stimulus variable in question 
on the subjects’ responses. 

Effect of race. Reiss, Schwartz, and 
Cottingham (20) were concerned 
mainly with verifying the utility of 
the (Thompson) Negro version of the 
TAT, but were also concerned with 
discovering the effect of the race of 
the examiner on the responses of the 
subjects to the Thompson TAT. 
“Fifteen Negro and 15 white students 


were tested by a Negro administrator 
and 15 Negro and 15 white students 
were tested by a white administra- 


tor’ (20, p. 704). ‘Thus, the inde- 
pendent variable of race is consti- 
tuted by one representative from each 
race. In light of that fact, consider 
the following conclusion drawn by 
the authors: “Northern white Ss 
produce longer stories than do North- 
ern Negroes when the stimulus ma- 
terial offers Negro figures regardless 
of the color of the examiner’’ (italics 
ours) (20, p. 708). 

Note that this conclusion follows 
from the comparison of the stories of 
white and Negro subjects to one white 
tioning as stimuli) typically found in the 
literature on social perception from photo- 
graphs, Brunswik (3, p. 38 and Table 2) has 
suggested the use of the lower case letter n 
for the size of the responder sample and of the 
capital letter N for the size of the ecological 
or object sample. This system has been used 
in the present paper also. 
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and one Negro examiner. It is appar- 
ent that while there is a potentially 
adequate sample of n=60 subjects, 
the size of the object (or ecological) 
sample is thus a bare N=2 (for the 
use of m vs. N see footnote 2). If, in 
fact, “it is clear that the statistical 
significance of a result may be in- 
vestigated in both directions” (3, p. 
36), then we may legitimately ask 
how it is possible to generalize from 
results obtained with one representa- 
tive of each race as a stimulus, any 
more than if the experiment included 
only one member from each race as a 
subject? Generalization from sample 
to population is necessary on both 
sides of this experiment and the sta- 
tistical rules which permit generaliza- 
tion hold under both conditions. For 
Reiss et al. to compare the results ob- 
tained under the conditions described 
above with Thompson’s results is just 
as meaningless as if the two experi- 
ments were each carried out with a 
single subject. Clearly, an invalid 
generalization is drawn in the above 
experiment. Only a representative 
type of experimental design in which 
adequate consideration of the situa- 
tion to which the experimenter 
wishes to generalize is given would 
permit valid generalization concern- 
ing the effect of the stimuli. 

Effect of sex. Curtis and Wolf re- 
port an experiment in which the prob- 
lem is stated as follows: ‘To study 
the influence of the sex of the exam- 
iner on the production of sex re- 
sponses on the Rorschach” (8, p. 
345). The subject-population sample 
consisted of 586 Rorschach records. 
The independent variable, sex of the 
examiner, was constituted by three 
female and seven male examiners. 
The conclusions are: ‘‘There is a sig- 
nificant difference between our male 
and female examiners on the number 
of records with sex responses.” 
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This experiment suffers from the 
same lack of attention to the estab- 
lishment of an independent variable 
as the experiment discussed earlier. 
Note the elaborate concern of the 
authors to establish subject-popula- 
tional generality (7 =586). Contrast 
this sampling procedure with that on 
the stimulus side (male V =7, female 
N=3). Yet it is the latter sample 
which constitutes the independent 
variable and which therefore leads to 
the conclusion that the sex of the 
examiner influences the response of 
the subject. This type of imbalance 
(favoring n over .V) is characteristic 
of the indiscriminate application of 
systematic design. Again, there is a 
clearly invalid generalization on the 
stimulus side of the experiment which 
only representative design can 
remedy. 

An approximation to representative 
design. An example of an “effect of 


the examiner” experiment which ap- 


proximates representative design 
may be found in Gibby (14). Twelve 
examiners each tested 20 patients 
under one set of conditions, and in 
the second set of conditions “one 
hundred thirty-five subjects were 
used, each randomly assigned to one 
of nine examiners” (14, p. 450). Al- 
though this experiment also shows 
marked imbalance (subject ’s equal- 
ing 240 and 135, and object N’s 
equaling 12 and 9), a better approxi- 
mation is obtained here than in any 
other experiment of this sort seen by 
the writer. Gibby’s experiment is 
cited mainly to illustrate that repre- 
sentative design does not present in- 
superable difficulties. 

One further point. If the experi- 
menter wishes to limit his conclusions 
to the particular conditions of the ex- 
periment (as is frequently the case in 
applied problems), we have no criti- 
cism. If, for example, Reiss et al. 
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wish to point out that this examiner 
produces (or does not produce) differ- 
ent responses than that examiner, we 
have no criticism. Generalizations 
such as those made in the above ex- 
periments, however, demand ran- 
domization—and randomization is 
what is lacking. 

In summary, unwarranted conclu- 
sions concerning the effect of the 
examiner occur as a result of failure 
to establish the crucial independent 
variable. It is important to note that 
failure to establish the independent 
variable occurs as a result of applying 
the logic of statistical inference to one 
side of the experiment only. 


MULTIFACTOR SYSTEMATIC DESIGN 


This concerned with 
multifactor systematic design (fac- 
torial design) methods and_ repre- 
sentative design. We begin with an 
example from the same field of re- 
search as in the previous section. 

Sex and method of administration. 
Gartield, Blek, and Melker (13) were 
concerned with ascertaining the effect 
of the sex of the examiner and two 
methods of administration (complete 
session and interrupted session) upon 
TAT stories. Two male and two fe- 
male examiners constituted the sex 
variable and one of each was assigned 
to the different methods. The experi- 
menters also wished to discover 
whether differential effects would be 
obtained with male (n=54) and fe- 
male (m==56) subjects. Although the 
experimenters do not treat their re- 
sults completely in terms of a fac- 
torial design, most readers will recog- 
nize that the conditions of the experi- 
ment allow use of a 222 design as 
in ‘Table 1. For purposes of illustra- 
tion we will assume that Garfield et al. 
did set their experiment up in this 
fashion. This assumption will in no 
way invalidate our analysis. 


section is 
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TABLE 1 


EXAMPLE OF FACTORIAL DESIGN 


Split Session 
Male / Female E 


Fe Ss 


Male Ss 


Male Ss Fe Ss 


A useful, although uncustomary, 
step in analyzing the independent 
variables of experiments designed in 
this fashion is to separate the physi- 
cal condition variables from the ‘‘per- 
son condition” variables. If, for 
example, the independent variables 
include 2 methods, 2 types of exam- 
iners, and 2 types of subjects, as 
does the Garfield experiment, it is 
important to note that we have a set 
of physical conditions (methods) and 
two sets of “person’’ conditions. In 
the experiment under discussion, the 
“person” conditions can be further 
broken down into subjects and ‘‘ob- 
jects,” i.e., examiners. 

Person conditions (subjects). Vhe 
customary principles of subject-popu- 
lation sampling apply here and need 
no discussion. 

Person condition (objects). Again it 
is easy to see that the same restric- 
tions concerning generalization apply 
here as in subject sampling. Failure 
to observe these restrictions results in 
Garfield’s unjustified generalization 
that sex of the examiner does not in- 
fluence the subjects’ response. Fac- 
torial design per se does not remove 
these restrictions. As Edwards says 
in discussing a similar hypothetical 
factorial design experiment wherein 
instructors and methods constitute 
the independent variables, “let us 
suppose that we have selected the 
instructors to represent particular 
types or personalities or abilities. 
The three used in the experiment are 
definitely not a random sample from 


Complete Session 
Male E 


Female £ 


Male Ss 


Fe Ss 


Male Ss 


Fe Ss 
any defined population” (10, p. 249). 
In other words, generalization to 
other instructors is prohibited; con- 
clusions are confined to the particular 
instructors involved in the experi- 
ment. 

Here we would like to point out 
that in “effect of the examiner” ex- 
periments it ordinarily will be more 
important to achieve  preciseness 
with regard to the independent varia- 
ble than the dependent variable. 
That is, we will be primarily con- 
cerned with the problem of whether 
or not certain examiner variables 
make a difference—to whom (that is, 
to which subject-population) they 
make a difference will ordinarily be of 
less concern. Therefore sampling of 
objects (examiners) will require a 
larger sample, more carefully con- 
sidered in terms of representative- 
ness, than will sampling of subjects. 

Physical conditions. Were the issue 
of sampling and generalization be- 
comes somewhat obscure. It is not 
easy to conceive of methods, or tests, 
or other physical conditions being 
selected by means of random sam- 
pling procedures. Yet this issue of 
random selection of conditions has a 
very important and practical bearing 
on factorial methods, for it can be re- 
duced to the question of what one 
considers to be the error term in the 
design (within-groups variance or 
interaction variance) against which 
to test the significance of main effects 
or interaction effects. We turn now 
to this question. 
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WITHIN-GROUPS VARIANCE AS ERROR 


Under the circumstance where the 
physical conditions of the experiment 
are selected by nonsampling methods, 
generalization must be confined to 
the population of subjects sampled 
with respect to the particular physical 
conditions present in the experiment. 
Within-groups variance is legitimate 
as error, since here is where random 
sampling took place. Therefore, gen- 
eralization takes phic e with regard to 
subjec ts only. 
3ut—-what about generalizations 
concerning the conditions of the ex- 
periment? Here the crucial issue be- 
tween systematic factorial design and 
representative design lies in the man- 
ner of covariation of the physical con- 
dition variables among one another. 
Unless their arrangement (not merely 
their number) in the experiment is 
considered in light of the conditions 
toward which the generalization is 
aimed, our conclusions are restricted 
from that generalization. 

Fisher was very conscious of the 
necessity for achieving generalization 
concerning the range of conditions. 
lor example: ‘‘The exact standardi- 
zation of 
which is 


experimental 
often 


conditions, 
thoughtlessly advo- 
cated as a panacea, always carries 
with it the real disadvantage that a 
highly standardized experiment sup- 
plies direct information only in re- 
spect of the narrow range of condi- 
tions achieved by standardization. 
Standardization, therefore, weakens 
rather than strengthens our ground 
for inferring a like result, when, as is 
invariably the case in practice, these 
conditions varied” 
(11, p. 97). Fisher also considered 
the problem of the arrangement of 
conditions to be extremely important 
in multivariate designs and wrote 
two papers (12, Ch. 17, 28) contrast- 


are somewhat 
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ing the systematic arrangement of 
field conditions to random arranve- 
ment—to the disadvantage of system- 
atic arrangement. Brunswik draws 
the issue more sharply, pointing out 
that ‘‘generalizability of results con- 
cerning ...the variables involved 
must remain limited unless at least 
the range, but better also the distri- 
bution ... of each variable, has been 
made representative of a carefully 
defined universe of conditions” (3, 
p. 53). Brunswik goes beyond 
Fisher in asserting that systematic 
factorial designs frequently ‘“‘tie,”’ or 
link together, physical condition vari- 
ables according to the convenience 
(sometimes arithmetic) of the experi- 
menter’s circumstance (3, p. 6). Like- 
wise, variables may be “untied”; 
that is, the links or correlations 
among variables in the situation to 
which the results are to be applied 
are often disrupted, usually through 
the “hold all other variables con- 
stant,” or “isolate a variable’ pro- 
cedure. Note the manner in which 
certain stimulus variables are arbi- 
trarily ‘‘tied’”’ and “untied’”’ in the 
following example. 

Personality and sex. Holtzman (17) 
interested in ascertaining the 
effect of the examiner as a variable in 
the Draw-A-Person Test. His pro- 
cedure in establishing the independ- 
ent variables of sex and of personality 
was as follows: 


Was 


Four experienced examiners, two male and 
two female, were chosen from a group of ad- 
vanced graduate students in clinical psychol- 
ogy. ‘The two pairs of examiners were selected 
to maximize differences in examiner ap- 
pearance and personality within both sexes. 
Ixaminer M1 was nearly a foot taller and 
sixty pounds heavier than the other male 
examiner, M2. The two female examiners, 
Fl and F2, were approximately the same size 
but differed considerably in feminine qual- 
ities” (17, p. 145). 


SO aS 


In line with our general emphasis 
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on the need for scrutinizing the man- 
ner in which the independent variable 
is constituted in these experiments, 
note that height and weight were 
“separated”’ or varied ‘‘within sex” 
for the male examiners (M1 was a 
foot taller and sixty pounds heavier 
than M2). On the other hand, the 
height of the female examiners was 
the same (their weights are not 
mentioned), but their “‘feminine qual- 
ities’ “differed considerably.” Ap- 
parently several different stimulus 
variables are ‘‘tied”’ (height with fe- 
male sex) and ‘‘untied”’ (height and 
weight from male sex and ‘feminine 
qualities” within female sex). This 
situation obscures the independent 
variable. This obscurity is bound to 
result when randomization is not 
effected in the sampling procedures, 
whether we are dealing with sampling 
of subjects or ‘‘objects”’ (in this case, 
examiners) .? 

Thus, when conditions are not 
samples, generalization is limited to 
the subject-population and therefore 
within-group variance is the only 
legitimate error term. 


INTERACTION TERMS AS ERROR 
Now 


consider the circumstance 

3 Note the hypothesis to be tested under 
these circumstances ‘(/) The sex of the ex- 
aminer has a measurable effect... (2) The 
personal characteristics of the examiner aside 
from sex have a measurable effect...” 
(17, p. 145). The ‘‘male variable” is estab- 
lished by drawing two males from the popula- 
tion, one each from some hypothetical per- 
sonality-type population. The same for the 
“female variable.” From this sample of ex- 
aminers Holtzman attempts to refute the 
findings of Sinnett and Eglash (22) (who also 
used two examiners) concerning the relation- 
ship between examiner personality and re- 
sponse to the Draw-A-Person Test. Obviously 
these particular examiners differed in many 
variables other than sex characteristics. Such 
variables can be eliminated as ‘“‘causes” of 
results only by randomization—exactly as 
they are eliminated in sampling subject popu- 
lations. 


where the interaction term might be 
considered as error. This is the point 
at which textbooks begin to meet the 
problem of random sampling of phys- 
ical conditions. In his discussion of 
the interaction term as error in his 
Design of Experiments (11, pp. 201- 
205), Fisher deals with the problem of 
random sampling of conditions al- 
most to the exclusion of other topics. 
Both Edwards (10) and Lindquist 
(18) consider this problem in connec- 
tion with psychological and educa- 
tional experiments in which methods, 
schools, etc. are conditions of the 
experiment. 

Edwards (10, p. 252) in discussing 
interactions as error terms states, 
‘“..it would be illogical to argue 
that the ... particular methods... 


selected for investigation have been 
randomly selected from a population 
of methods.” Lindquist (18, p. 169) 
discusses this problem through a hy- 
pothetical experiment where style 


and size of type are the independent 
variables. “ ... the particular styles 
(or sizes) involved may not strictly 
be considered as a random sample 
from a ‘population’ of styles (or 
sizes). The interaction variance in a 
factorial design is therefore usually 
not strictly a measure of normally 
distributed random fluctuations, 
which theoretically must be true of 
the error term in any F-test or t-test.” 

When discussing the necessity for 
randomness in the use of interaction 
terms as error terms, Edwards makes 
very explicit the fact that it is ‘‘illogi- 
cal to argue”’ that particular methods 
have been “randomly selected’’ and 
that particular instructors cannot be 
considered random samples. Yet he 
chooses as an example an experiment 
by Child (7) which violates this re- 
quirement (10, p. 261). Edwards de- 
scribes the conditions as follows: 
“The variables introduced were as 
follows: the sex of the children used 
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as subjects in the experiment; the sex 
of the experimenter present during 
the test situation; the nature of the 
barrier introduced between the sub- 
ject and the distant goal object; and 
the type of instructions given to the 
child.”” Child recognizes that his 
conclusion that ‘‘choice of a distant 
goal was more frequent in the pres- 
ence of a woman experimenter than 
in the presence of a man experimen- 
ter” is “severely limited by the fact 
that the sample of experimenters 
was limited to one of each sex’”’ (7, 
p. 30). However, Child does use the 
pooled interaction term as_ error. 
“The 11 degrees of freedom pertain- 
ing to the 11 possible interactions 
were therefore pooled for an estimate 
of error” (7, p. 19). If the writer has 
correctly identified Child’s interac- 
tion terms, four (/¢Xbarrier Xin- 
structions, /Xbarrier, / Xinstruc- 
tions, barrier Xinstructions) of the 11 
interactions do not include a variable 
selected at random. As Edwards put 
it, “furthermore, and this is most 
important, it is necessary that the 
categories of one or more of the varia- 
ables in the experimental design be a 
random selection from the population 
being sampled” (10, p. 252). This is 
followed by a footnote: ‘This condi- 
tion will not be met by argument 
after the experiment has been carried 
through to completion.”’ 

In summary, then, random sam- 
pling of the conditions, physical or 
otherwise, of the experiment is pre- 
requisite to the use of interaction 
terms as error variance. Ignoring 
this prerequisite violates the princi- 
ple of generalization through ran- 
domization in exactly the same fash- 
ion as in the case of a nonsampling 
one-factor design. 


AGRICULTURAL DESIGNS IN 
PSYCHOLOGY 


The above remarks concerning 
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interaction terms lead directly to 
another issue—the use of agricultural 
designs in psychology. For example, 
in Lindquist’s discussion of interac- 
tion terms as error, after very clearly 
pointing out the logic involved in 
compromising with the statistical as- 
sumptions involved, he concludes the 
discussion by emphasizing that 
“...the procedure just recom- 
mended is arbitrary in character, 
although wide experience in agri- 
cultural research indicates that it 1s 
usually satisfactory” (italics ours) (18, 
p. 170).4. Snedecor, however, while 
discussing interaction terms as error 
terms in connection with an agricul- 
tural experiment, says, ‘The require- 
ment of randomness is apparently 
never met in this kind of work, so 
that statements about probability 
must be considered inexact’ (23, p. 
303). 

The remarks concerning 
agricultural research have been em- 
phasized because they are the key to 
a fundamental The issue is 
whether the application of agricul- 
tural experimental procedures to psy- 
chological experiment needs further 
scrutiny. We believe that such 
scrutiny is in order on grounds that 
there are important discrepancies be- 
tween the aims and conditions of 
most agricultural research and most 
psychological research. The follow- 
ing points bear on this question. 

The type of agricultural research 
for which Fisher developed factorial 
design was primarily engineering- 
type He was concerned 
“... that, in any case, there will be 
no reason for rejecting the experi- 


above 


issue. 


research. 


* Lindquist also notes (18, p. 169) that 
there will be some circumstances where this 
procedure will not be reasonable. 

§ See McNemar (19) for a discussion of an 
important difference in the conditions of agri- 
cultural and psychological research in connec- 
tion with latin-square design. 
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mental results on the ground that the 
test was made in conditions differing 
in one or other of these respects from 
those in which it is proposed to apply 
the results” (11, p. 98). In engineer- 
ing-type experiments the selection 
and arrangement of the conditions 
are usually dictated by the particular 
circumstances to which the experi- 
menter wishes to apply his results 
and to which he confines his results 
and conclusions, as made 
clear. A further characteristic of 
engineering-type experiments is that 
future conditions are under the con- 
trol of the experimenter, so that he 
can maintain the conditions of the 
experiment, e.g., issuing the same 
ratios of ingredients in the ration, the 
same ratios of chemicals in the fer- 
tilizer, etc., as used in the experi- 
ment. ‘Therefore, Fisher’s factorial 
design methods are eminently appro- 
priate to the applied problems with 
which he was concerned. Where the 
problem of generalizing beyond a 
particular plot—the soil heterogene- 
ity problem—was concerned, how- 
ever, he was definite and explicit 
about the advantages of randomiza- 
tion. (See 11, 12.) 

Psychologists, however, have other 
problems at stake than those of appli- 
cation; for example, it is in the nature 
of the theoretical task to seek gen- 
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erality. It seems legitimate, there- 
fore, to ask if psychologists really 
wish to confine their conclusions to 
the particular conditions of the ex- 
periment, in which the manner of 
arrangement of the variables is fre- 
quently due to convenience, or as 
Fisher put it, due to the ‘‘thoughtless 
advocation of standardization as a 
panacea” (11, p. 97). Moreover, if 
the future conditions to which the 
psychologist wishes to predict are not 
under his control, it also seems legiti- 
mate to ask if the manner of co- 
variation of the variables has been 
maintained in the experiment as in 
the future situation. If the psy- 
chologist does not wish to accept the 
limitations of systematic design, how- 
ever, a thorough scrutiny of the prin- 
ciples of representative design is in 
order, for it is precisely the question 
of generalization with which repre- 
sentative design is concerned. 


SUMMARY 


This paper illustrates how unwar- 
ranted conclusions may he reached 
through the application of traditional 
systematic design to a given problem 
in clinical psychology—the effect of 
the examiner on the subjects’ re- 
Both one-factor and multi- 
factor designs are discussed. 


sponses. 


REFERENCES 


1. Brunswik, E. 
and environmental probability. 
chol. Rev., 1943, 50, 255-272. 

2. BRUNSWIK, E. Distal focussing of per- 
ception. Size-constancy in a representa- 
tive sample of situations. Psychol. 
Monogr., 1944, 56, No. 1 (Whole No. 
254). 

3. BRUNSWIK, EF. Systematic and representa- 
tive design of psychological experiments. 
Berkeley: Univer. of California Press, 
1947. (Also in J. Neyman [Ed.], 
Berkeley symposium on mathematical 
statistics and probability. Berkeley: Uni- 


Organismic achievement 
Psy- 


ver. of California Press, 1949. Pp. 143- 
202.) 

. BRUNSWIK, E. 
analogy between 
sentativeness.”’ 
212-217. 

Brunswik, E. The conceptual framework 
of psychology. Chicago: Univer. of Chi- 
cago Press, 1952. (Int. Encycl. unified 

1, No. 10.) 

3RUNSWIK, E., & Kamiya, J. Ecological 

cue validity of “proximity” and of other 
Gestalt factors. Amer. J. Psychol., 
1953, 66, 20-32. 


Hammond's 
‘relativity and repre- 
Phil. Sct., 1951, 18, 


Note on 


‘ 


wiles S, 





REPRESENTATIVE 


7. CutLp, I. L. Children’s preference for 
goals easy or difficult to obtain. Psy 
chol. Monogr., 1946, 60, No. 4 (Whole 
No. 280). 


. Curtis, H. S., & Wor, E. B. The in- 


fluence of the sex of the examiner on the 
responses on the 
Psy hol gist, 


production of sex 
Rorschach. Amer 
6, 345. (Abstract) 
DukEs, W. F. 


ness in 


1951, 


Ecological representative 

studying perceptual — size- 
constancy in childhood. Amer. J. Psy 
chol., 1951, 64, 87-93. 

Epwarps, A. L. 
psychological research. 
Rinehart, 1950 

. FISHER, R. A. The design of experiment 
(4th Ed.) New York: Hafner, 1947. 

FIsHER, R. A. Contributions to mathemati- 

cal statistics. New York: Wiley, 1950. 

13. GARFIELD, S. L., BLek, L., & Mevker, F. 
The influence of method of administra 
tion and sex differences on selected 
aspects of TAT’ stories J. consult 
Psychol., 1952, 16, 140-144 

14. Gipsy, R. G. 
Rorschach inquiry. J. consult. Psychol., 
1952, 16, 449 

15. HAMMOND, K. R. nd object 
sampling—a note. Psychol. Bull., 1948, 
45, 530-533. 


Experimental design in 


Pail 
York: 


‘ 
Yew 


Examiner influence on the 


$55. 
Subjec ta 


VERSUS SYSTEMATIC DESIGN 


16. 


17. 


2. SINNETT, E. 


3. SNEDECOR, G. W. 


159 


HAMMOND, K. R. 
sentativeness. 
208-211. 

Ho_tzMan, W. H. The examiner as a 
variable in the Draw-A-Person Test. 
J. consult. Ps ye hol., 1952, 16, 145-148. 

Linpguist, E. F. Statistical analysis in 
educational research. Boston: Houghton 
Mifflin, 1940. 

McNemar, Q. On the use of latin squares 
in psychology. Psychol. Buill., 1951, 
48, 398-401. 

Reiss, B. F., Schwartz, E. K., & 
CortinGHaM, ALice. An experimental 
critique of assumptions underlying the 
Negro version of the TAT. J. abnorm. 
soc, Psyc hol., 1950, 45, 700-709. 

RoBINSON, D., & RouprE, S. Two experi 
ments with an anti-Semitism poll. J. 

Psychol., 1946, 41, 136 


Relativity and repre- 
Phil. Sct., 1951, 18, 


abnorm. soc. 
144. 

R., & EGiasu, A. The ex- 
aminer-subject relationships as a vari- 
able in the Draw-A-Person Test. Paper 
read at the Midwest. Psychol. 
Detroit, May, 1950. 


\ss., 


Statistical methods. 
Id.) Iowa: State Coll. 


1946. 


(4th 
Press 


Ames, 


Received June 14, 1953 





PSYCHOLOGICAL BULLETIN 
Vol. 51, No. 2, 1954 
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In an excellent paper, Moses (13) 
presents some of the principal non- 
parametric methods and an intuitive 
explanation of their rationale, prop- 
erties, and applicability, with a view 
to facilitating their use by workers in 
psychological research. One of the 
important topics in the field of non- 
parametric methods is the Kolmo- 
gorov-Smirnov statistic. Recent re- 
sults and tables on this topic have 
been prepared which contribute to- 
ward establishing the Kolmogorov- 
Smirnov statistic as a standard non- 
parametric tool of statistical analysis. 

We shall present an intuitive ex- 
planation of the rationale and uses of 
the Kolmogorov-Smirnov statistic. 


A table will be presented which facili- 


tates the use of the Kolmogorov- 
Smirnov statistic by research work- 
ers. Some illustrative examples will 
also be given. 


1. T'wo-SipEp TEstTs 
1.1. One-Sample Test 


In this section tests of ‘goodness of 
fit’’ will be considered. That is, we 
shall be concerned with the agree- 
ment between the distribution of a 
set of sample values and a theoretical 
distribution. Probably the most wide- 
ly used nonparametric test of ‘‘good- 
ness of fit’’ is the chi-square test (4). 
However, some evidence has been 
presented indicating that the test 
which we shall now describe, the 


1 This paper was prepared in connection 
with research supported by the Office of Naval 
Research at the Statistical Research Center, 
University of Chicago. The author wishes to 
thank Mr. Herbert David, University of 
Chicago, for helpful comments. 
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Kolmogorov-Smirnov test for good- 
ness of fit, may be a better all-around 
test, when it is applicable, than the 
chi-square test (1, 12). A concise de- 
scription of other tests of fit appears 
in (2). 

Suppose that a _ population is 
thought to have some completely 
specified cumulative frequency dis- 
tribution function, say F(x). That is, 
for any specified value of x, the value 
of F(x) is the proportion of individu- 
als in the population having measure- 
ments less than or equal to x. The 
observed cumulative step-function 
Sy(x) of a sample of N observations 
(that is, Svy(x)=k/N, where k is the 
number of observations less than or 
equal to x) is expected to be fairly 
close to this completely specified dis- 
tribution function F(x). If it is not 
close enough, we have evidence that 
the hypothetical distribution F(x) is 
not the correct one. As a measure of 
how far the observed cumulative 
step-function Sy(x) is from the hy- 
pothetical distribution F(x) we use 
the maximum absolute difference d 
between Sy(x) and F(x); that is, 
d=maximum,| F(x) —Sy(x)|. When 
d is large we have evidence that F(x) 
is not the correct population cumu- 
lative frequency distribution func- 
tion. 

Let us first consider the case where 
F(x) is a continuous cumulative dis- 
tribution function. If the correct 
population cumulative distribution is 
in fact F(x), then the sampling dis- 
tribution of d is known and has been 
tabled (1). For example, if F(x) is the 
correct population distribution, we 
find from p. 428 in (1) that the prob- 
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ability that d25/15 is Pr{d2=5/15} 
=1—Pr{d<5/15} =1— .945 =.055, 
and Pr{d2=6/15} =1—.989=.011 for 
a sample of N=15 observations. 

Hence, in order to test the null hy- 
pothesis that F(x) is the correct popu- 
lation distribution using a sample of 
N=15 observations, the maximum 
absolute deviation d between the 
sample cumulative — step-function 
Sis(x) and F(x) is computed. The 
null hypothesis is rejected when 
d=5/15, if the null hypothesis is 
tested at the .055 level of significance. 
If the test is at the .011 level of sig- 
nificance, the null hypothesis is re- 
jected when d26/15. 

Let us now consider the case where 
F(x) may be a discontinuous cumula- 
tive distribution function. Several 
articles dealing with the Kolmogorov- 
Smirnov tests claim that the methods 
apply only where the chance variable 
is continuous. ‘This is true only if 
exact probability statements are re- 
quired. (The reader will note that 
exact probability statements cannot 
be made even if the chi-square sta- 
tistic is used to test goodness of fit 
since little is known about the actual 
sampling distribution of the chi- 
square statistic for finite sample size 
N and given F(x). The chi-square 
statistic becomes approximately dis- 
tribution-free when the sample size 
N approaches infinity, but is not dis- 
tribution-free for finite N.) The in- 
equalities stated in (5, 7) serve to 
validate the use of the Kolmogorov- 
Smirnov statistic in the case where 
F(x) may be discontinuous. From 
these inequalities we see that when 
F(x) may be discontinuous, the error 
obtained will be in the ‘“‘safe direc- 
tion” if tables are used which assume 
that F(x) is continuous. More pre- 
cisely, the level of significance of a 
test .based on the sampling distribu- 
tion of d will be no larger than the 
level of significance of that test when 
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F(x) is assumed continuous. For ex- 
ample, if F(x), which may be discon- 
tinuous, is the correct population dis- 
tribution function, we find from the 
tables on p. 428 of (1) that the prob- 
ability that d25/15 is at most .055, 
and Pr{d26/15} S.011 for a sample 
of N=15 observations. Hence, in 
order to test the null hypothesis that 
F(x), which may be discontinuous, is 
the correct population distribution, 
the value of d is computed. If the 
null hypothesis is rejected when 
d= 5/15, then the level of significance 
is, at most, .055. The test will be at 
no more than the .011 level of signifi- 
cance if the null hypothesis is re- 
jected when d26/15. Hence, if the 
same test is used as when F(x) was 
assumed continuous, the level of sig- 
nificance will be no more than .055 
(or .011). 

The Kolmogorov-Smirnov statistic 
can also be used to estimate prob- 
abilities and obtain confidence bands 
for the true cumulative distribution 
function F(x) (1,7, 10, 15, 16). These 
confidence bands will be free from 
any restriction concerning the nature 
of the function F(x). We need not 
that F(x) is continuous in 
order to obtain confidence bands for 
F(x). Let us illustrate this use with a 
particular set of data. A sample of 15 
observations was obtained. If this 
sample is arranged in order of in- 
creasing size, we obtain 


i, 2, 2, 2, 2, 4, 4, 4,4, 5,3, 3, oe 


assume 


The reader may be interested to 
know how these 15 observations were 
obtained. A student was asked to list 
three men whom he liked and three 
men whom he did not like from 
among all the men he had known 
since birth. The number 0 was as- 
signed to the person liked the best, 
number 1 to the person liked second 
best, number 2 to the person liked 
third best, and so on, and 5 was as- 
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signed to the person disliked the 
most. He was then asked to place the 
number 0 on a sheet of paper if he 
thought that his number 0 person 
(best-liked person) would be the 
richest (among the total of six men 
listed). He was to place the number 
1 on the paper if he thought that his 
number 1 person (second best liked) 
would be richest, and so on, and the 
number 5 if he thought that the per- 
son he disliked most would be the 
richest among the six. Hence, a single 
number from 0 to 5 was obtained 
from this student. Fifteen such ob- 
servations were obtained by using 
fifteen different students as the sub- 
jects. The sample cumulative step- 
function Sj5(x) for the 15 observa- 
tions is given in Fig. 1. From the 
tables on p. 428 in (1) we see that the 
chance is at least .945 that the maxi- 
mum deviation between S);(x) and 
the true cumulative distribution F(x) 


1 
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will be less than 5/15. Hence, if a 
band of width 5/15 is drawn above 
and below S);(x), we can state with 
at least “94.5 per cent confidence” 
that the true cumulative distribution 
F(x) lies within that band. The 94.5 
per cent confidence band for F(x) is 
illustrated in Fig. 1 by the dotted 
lines above and below S;;(x). There- 
fore, any number of statements of 
the following kind may be made 
simultaneously with at least 94.5 per 
cent confidence: F(0)<1/3, F(3) 
<2/3, and F(4) is a number between 
26.667 per cent and 93.333 per cent. 

Let us consider the null hypothesis 
that a student is equally likely to 
choose any one of the six numbers. 
Then the population cumulative dis- 
tribution function F(x) would be as 
given in ‘Table 1. The values of 
Sis(x) and | F(x) — Sis(x) | are also 
given in the table. Since the maxi- 
mum absolute difference between 
F(x) and Sjs(x) is 10/30=5/15, the 
null hypothesis is rejected at the .055 
level of significance. 

The reader will note that the sig- 
nificance test which was performed 
was for a completely specified popu- 
lation cumulative distribution func- 
tion F(x). In cases where parameters 
must be estimated from the sample 
(for example, when the null hypothe- 
sis is that the population distribution 
is normal with unspecified mean and 
standard deviation, and the mean 
and standard deviation must first be 
estimated from the sample), there are 
no theoretical results at present 
which give exact critical levels for the 
Kolmogorov-Smirnov statistic. The 
distribution of d is not known when 
certain parameters of the population 
have been estimated from the sample. 
It may be expected, however, that 
the effect of adjusting the population 
mean and standard deviation to those 
of the sample will be to reduce the 
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TABLE 1 


ABSOLUTE DIFFERENCE BETWEEN A SPECIFIED F(x) AND Sis(x) FOR A SAMPLE 
OF 15 OBSERVATIONS 


| F(x) — Sis(x) | 


critical level of d. If the critical 
value of d (from tables which assume 
a completely specified population 
distribution) is exceeded in these 
circumstances, we may safely con- 
clude that the discrepancy is signifi- 
cant (see p. 73 of [{12]). In cases 
where parameters must be estimated 
from the sample, the chi-square test 
is easily modified by reducing the 
number of degrees of freedom. The 
Kolmogorov-Smirnov test has no 
such known modifications. 


1.2. Two-Sample Test 


In this section the problem of test- 
ing whether two random samples 
have been drawn from the same 
population is considered. ‘That is, 
we shall be concerned with the agree- 
ment between the distributions of 
two sets of sample values. 

Let us denote the observed cumu- 
lative step-function of the first sam- 
ple of N observations by Sy(x), and 
let S’y(x) be the observed cumu- 
lative step-function of the second 
sample of M observations. The two 
cumulative step-functions Sy(x) and 
S’u(x) are expected to be fairly 
close to each other if both sam- 
ples are drawn from the same popula- 
tion. If they are not close enough, 
we would have evidence that the 
samples come from diflerent popula- 
tions. (That is, the population cumu- 
lative distribution function for the 
values from the first sample is differ- 
ent from the population cumulative 
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distribution for the values from the 
second sample.) As a measure of how 
far apart are the two cumulative 
step-functions we use the maximum 
absolute difference d’ between them; 
that is, d’=maximum, Sy(x) 
—S’y(x)|. When d’ is large we have 
evidence that the samples came from 
different populations. 

Let us first consider the case where 
the values from both samples are as- 
sumed to have continuous population 
cumulative distributions F(x) and 
G(x), respectively. We wish to test 
the null hypothesis that F(x) =G(x) 
and the null hypothesis will be re- 
jected if the observed value of d’ is 
significantly large. The limiting dis- 
tribution of d’ has been tabled in (15), 
and a method of obtaining the exact 
distribution of d’ for small samples 
has been given (11) when in fact 
F(x) =G(x). A short table for equal 
size samples is also available (11). 
The explicit expression for the dis- 
tribution function of d’ has been 
given recently in (6) for equal size 
samples. From the tables on p. 126 
of (11) we find that, say, in the case 
where AJ=N=15, the probability 
that d’27/15, when in fact F(x) 

G(x), is Pr{d’27/15} =1—Pri{d’ 
6/15} =1—.925=.075, and Pr{d’ 
= 8/15} =1—.974=.026. Hence, in 
order to test the null hypothesis that 
F(x) =G(x) at the .075 level of sig- 
nificance, the value of d’ is computed 
and the null hypothesis is rejected 
when d’27/15. If the test is at the 
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.026 level of significance, the null hy- 
pothesis is rejected when d’ 28/15. 

Let us now consider the case where 
F(x) and G(x) may be discontinuous 
cumulative distribution functions. 
The inequalities stated in (7) serve 
to validate the use of the Kolmo- 
gorov-Smirnov statistic in the case 
where F(x) and G(x) may be discon- 
tinuous. Irom these inequalities, we 
see that when F(x) and G(x) may be 
discontinuous, the error obtained will 
be in the “safe direction” if tables 
are used (11) which assume that F(x) 
and G(x) are continuous. For exam- 
ple, suppose two samples are drawn 
each containing 15 observations (M 
= N=15). In order to test the null 
hypothesis that F(x)=G(x), the 
value of d is computed. If the null 
hypothesis is rejected when d’=7/15, 
the level of significance will be, at 
most, .075. The test will be at no 
more than the .026 level of signifi- 
cance if the null hypothesis is re- 
jected when d’ 28/15. The tests will 
be free from any restriction concern- 
ing the nature of the functions F(x) 
and G(x). We need not assume that 
the functions F(x) and G(x) are con- 
tinuous in order to obtain tests of the 
hypothesis that F(x) =G(x). 

Let us illustrate the problem of 
testing whether two samples have 
been drawn from the same popula- 
tion. We shall study the agreement 
between the sample of 15 observa- 
tions which was described in the pre- 
ceding section (numbers from 0 to 5 
obtained by using fifteen students as 
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subjects of an inquiry) and a second 
sample of 15 observations. If the 
second sample is arranged in order of 
increasing size, we obtain 


0, G, 6, 0, 1, 1, 2, 2, 2, 2, 2, 3, 5, 5, 5. 


(The reader may be interested to 
know that these 15 observations were 
obtained by using fifteen business- 
men as the subjects of the inquiry. 
That is, each businessman was in- 
terrogated in the same manner as the 
students. The businessman was then 
asked to choose the person who would 
be the richest among the six men 
listed in the order of his preference.) 
The values of the cumulative step- 
functions S,,(x) and S’\5(x) for the 
first and second samples respectively 
are given in Table 2. The values of 
| Sis(x) — S'15(x) | are also given in the 
table. Since the maximum absolute 
difference between Si5(x) and S’i5(x) 
is 7/15, the null hypothesis is re- 
jected at the .075 level of signifi- 
cance. 


2. ONE-SIDED TESTS 


2.1. One-Sample Test 


In Section 1.1 the statement was 
made that the Kolmogorov-Smirnov 
test for goodness of fit may be a 
better all-around test, when it is ap- 
plicable, than the chi-square test. By 
an all-around test of goodness of fit, 
we mean a test of the null hypothesis 
that the observed sample was drawn 
from a completely specified popula- 
tion without specifying the nature of 


TABLE 2 


ABSOLUTE DIFFERENCE BETWEEN THE CUMULATIVE STEP-FUNCTIONS FOR TWO SAMPLES 


EacH CONTAINING 15 OBSERVATIONS 
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the alternate hypotheses. That is, 
the null hypothesis that the observed 
sample was drawn from a completely 
specified population is tested against 
the alternate hypothesis that it was 
not drawn from that population. In 
some particular problems more spe- 
cific alternate hypotheses may be de- 
sirable. For example, very often we 
want to decide not whether an experi- 
mental group is the same or different 
from the general population, but 
whether the experimental group is 
better than the general population, 
or more adjusted than the general 
population, etc. In such cases, the 
null hypothesis that there is no differ- 
ence would be tested against the 


alternate hypothesis that the experi- 
mental group is better, or more ad- 
justed, etc. 

Let us consider the numerical il- 
lustration presented in Section 1.1 
where the null hypothesis that a stu- 
dent is equally likely to choose any 


one of the six numbers 0, 1, 2, 3, 4, 5 
was tested against the alternate hy- 
pothesis that the student is not 
equally likely to choose any one of 
the six numbers. For this particular 
problem and for the student body 
which was under investigation it 
seemed reasonable to expect that 
either (a) the six numbers would be 
equally likely or (b) there would be a 
tendency for the students to assign 
the higher numbers. Hence, in this 
case it is desirable to test the null hy- 
pothesis that the six numbers were 
equally likely against the alternate 
hypothesis that there was a tendency 
for the students to assign the higher 
numbers. 

Let us try to make more precise the 
statement that ‘‘there would be a 
tendency for the students to assign 
higher numbers.”’ If the six numbers 
were equally likely, then the propor- 
tion of the population assigning the 
number 0 would be F(0) =1/6. Also 
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the proportion assigning the number 
0 or 1 would be F(1) =2/6, and the 
proportion assigning numbers no 
larger than 2 would be F(2)=3/6. 
Similarly, F(3) =4/6, F(4) =5/6, and 
F(5)=1. If ‘there is a tendency to 
assign higher numbers,”’ then the pro- 
portion G(O) of the population assign- 
ing the number 0 would be no more 
than 1/6 (the case where all numbers 
are equally likely). Also the propor- 
tion G(1) assigning the number 0 or 1 
would be no more than 2/6, and the 
proportion, G(2) assigning the num- 
bers no larger than 2 would be no 
more than 3/6. Similarly G(3) $4/6, 
G(4) =5/6, and G(5) <1. Hence, the 
statement, “there would be a tend- 
ency for the student to assign higher 
numbers,’”’ may be replaced by the 
statement that the true population 
cumulative distribution function G(x) 
is no more than F(x); that is, G(x) 
< F(x) for all values of x. 

The null hypothesis that the true 
population cumulative distribution 
is, in fact, the specified F(x) is to be 
tested against the alternate hypothe- 
sis that the true population cumula- 
tive G(x) is no more than F(x) (with 
the “less than” relation holding for 
some values of x). This problem may 
be considered the one-sided analog of 
the problem discussed in Section 1.1 
where the null hypothesis that the 
true population cumulative distribu- 
tion is in fact the specified F(x) is 
tested against the alternate hypothe- 
sis that the true population cumula- 
tive is not F(x). Asa measure of how 
far the observed cumulative step- 
function Sy(x) is from the hypotheti- 
cal distribution F(x) we use the maxi- 
mum difference c between Sy(x) and 
F(x). That is, c=maximum, [F(x) 
—Sy(x)], which is the one-sided 
analog of the maximum absolute dif- 
ference d. When c is large, we have 
evidence that F(x) is not the correct 
population cumulative distribution 
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and that the true population cumula- 
tive G(x) is no more than F(x). If 
the correct population cumulative is 
continuous and is in fact F(x), then 
the sampling distribution of c¢ is 
known, and the explicit expression 
for the distribution function of ¢ is 
given by equation 3.0 on p. 593 in 
(3). Using equation 3.0, we find for 
example that when NV = 15 the chance 
that ¢ will be no more than 5/15 is 


1 ¥(°’) 
3 j=) j 
-\ 16-j -\ G1 
b-O°G+a"-« 
3 15 3 15 


Hence, the probability that «25/15 
is Pr{c>5/15}=1—.97=.03. In 
order to perform a ‘one-sided test” 
of the null hypothesis that (x) is the 
correct population distribution using 
a sample of N=15 observations, the 
value of ¢ is computed. The null hy- 
pothesis is rejected when ¢25/15 if 


P45(5/15) 


the test is at the .03 level of signifi- 
cance, 

For the particular numerical illus- 
tration presented in Section 1.1, we 


find that c=5/15. Hence, the null 
hypothesis that a student is equally 
likely to choose any one of the six 
numbers is rejected at the .03 level 
of significance, and the alternate hy- 
pothesis that there is a tendency to 
assign higher numbers is accepted. 
In Section 1.1 a method was given 
for obtaining two-sided confidence 
bands for the true cumulative dis- 
tribution function F(x). This method 
may be modified in order to obtain 
one-sided confidence bands for F(x). 
For example, Fig. 1 gives a two-sided 
94.5 per cent confidence band for 
F(x) obtained from a sample of 15 
observations. We might make the 
one-sided confidence statement that 
the true cumulative distribution F(x) 
lies below the upper limit of the band 
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presented in Fig. 1. From the results 
presented earlier in this section we 
see that there is at least “97 per cent 
confidence” that F(x) lies below the 
upper limit of the band in Fig. 1. 


2.2. Two-Sample Test 


In this section a one-sided analog of 
the problem discussed in Section 1.2 
will be considered. We wish to test 
the null hypothesis that the cumula- 
tive. distribution function F(x) for 
the values from the first sample is 
equal to the cumulative distribution 
function G(x) for the values from the 
second sample. In other words, the 
null hypothesis is that F(x) =G(x). 
The alternate hypothesis to be con- 
sidered is of a more specific nature 
than the alternate hypothesis for the 
all-around test presented in Section 
1.2. We shall be concerned with the 
alternate hypothesis that F(x) S$ G(x). 
If the alternate hypothesis is, in fact, 
true (with the “less than” relation 
holding for some values of x), we say 
that the population values from which 
the first sample was drawn are sto- 
chastically larger than the population 
values from which the second sample 
was drawn. The importance of such 
alternate hypotheses has been 
stressed in (8, 9). lor example, very 
often we want to decide not whether 
the experimental group is the same or 
different from the control group but 
whether the experimental group is 
better than the control group, or 
more adjusted than the control group, 
etc. In such cases the null hypothesis 
that F(*)=G(x) would be tested 
against the alternate hypothesis that 
F(x) <G(x). For this one-sided ana- 
log of the problem described in Sec- 
tion 1.2, we use the maximum differ- 
ence c’ between the observed cumula- 
tive step-functions Sy(x) and S’ (x) 
of the first sample of N observations 
and of the second sample of A/ ob- 
servations. That is, c’=maximum, 
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[S’ (x) —Sy(x)] which is the one- 
sided analog of the maximum abso- 
lute difference d’. When c’ is large, 
we have evidence that F(x) is not 
equal to G(x) and that the population 
values from which the first sample 
was drawn are stochastically 
than the population values trom 
which the second sample was drawn. 
If the population cumulative funce- 
tions are continuous and in fact F(x) 

G(x), then the limiting distribution 
of c’ is known (9, 14). If F(x) =G(x), 
we find that the sampling distribu- 
tion of 4(c’)?N/(M+N) will 
approximately a chi-square distribu- 
tion with two degrees of freedom 
when Af and N are large and M/N is 
not too close to either zero or in- 
finity. Hence, the tables of the chi- 
square distribution may be utilized 
to test the null hypothesis when \V/ 
and N are large. When J/ and N are 
small, the exact distribution of c’ may 
be computed by extending the count- 
ing method presented in (11) for the 
two-sided problem. The explicit ex- 
pression for the distribution function 
of c’ has been given recently (6) for 
equal-size samples. Table 3 may be 
used to test the null hypothesis at 
either the 20 per cent, 10 per cent, 
5 per cent, 1 per cent, or 0.1 per cent 
level of significance if M=N. The 
table gives the critical value of c’N at 
the various levels of significance. For 
example, when N=15 we see from 
Table 3 that 7 is the critical value of 
c’N at the 5 per cent level of signifi- 
cance. Hence, the null hypothesis is 
rejected at the 5 per cent level of sig- 
nificance if c’ 27/15. Using the ex- 
plicit expression (see [6]) for the dis- 
tribution function of c’, we find that 


lar ger 


have 


Pr tc’ = 7/15} 


1— Pr fe’ < 7/15} 


30 30 
-( )/( ) = 038, 
8 15 


Let us reconsider the numerical il- 
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TABLE 3 


CRITICAL VALUES OF c’N FOR THE a: 100 
Per Cent LEVEL OF SIGNIFICANCE 
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lustration presented in Section 1.2. 
Since c’ =7/15, we reject the null hy- 
pothesis at the .038 level of signifi- 
cance that the population distribu- 
tion of the numbers assigned by the 
students was the same as the popula- 
tion distribution of the numbers as- 
signed by the businessmen and accept 
the 
numbers assigned by the students 


the alternate hypothesis that 


were stochastically larger than those 
assigned by the businessmen. In 
other words, we accept the alternate 
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hypothesis that there was a greater 
tendency for the students to assign 
higher numbers than the business- 
men. 

It is interesting to note that if ap- 
proximate critical values are com- 
puted using the chi-square (with two 
degrees of freedom) approximation 
the approximate critical values are 
always more than the exact critical 
values (in ‘Table 3) minus 1. Hence, 
the error in using the chi-square ap- 
proximation is always in the “safe 
direction” 


for the levels of signifi- 
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cance in Table 3 even when the sam- 
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the chi-square approximation, it 
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In their original article (7) Webb 
and Lemmon stated that the results 
of the over-all F test may not agree 
with results obtained by subsequent 
use of the ¢ test applied to individual 
means when a functional relationship 
exists between the independent and 
dependent variables. They gave hy- 
pothetical examples which, they 
thought, illustrated their point. Pat- 
terson (5) and Diamond (1) have 
both taken exception to the original 
article, but Webb and Lemmon in 
their reply (8) stated that ‘‘. . . most 
of their [Patterson and Diamond's] 
criticisms have not been aimed 
directly at the core of our problem. 
Most of their discussion seems to deal 


with problems of the conventional 


of variance situation, in 
which the means of the groups show 
no trend, but are randomly related 
to each other....We were con- 
cerned, however, with a fairly com- 
mon experimental design in which 
the means of the groups show a 
definite ordering or trend, with re- 
spect to some other experimental 
variable.” 

In all four of the articles written by 
the above authors, analysis of vari- 
ance has been discussed as though its 
only use were to test for significance 
of differences between means. ‘This is 
probably what analysis of variance 
has been most often used for in psy- 
chological research, but it has other 
uses which are just as important as 
the test of differences between means. 
One of the other uses of analysis of 
variance is that of testing to see 
whether there is a significant linear 


analysis 


or curvilinear regression hetween the 
independent and dependent variables. 
This is the test which should be used 
with Webb and Lemmon’s data since 
they hypothesize that a functional 
relationship exists. This test may be 
performed by an extension of the con- 
ventional analysis of variance pro- 
cedure. Fisher’s (2) method of orthog- 
onal polynomials is convenient to 
use for this analysis. Snedecor (6, 
Ch. 14, 15) discusses in detail the 
procedures necessary to make this 
analysis, and Johnson and Tsao (3) 
give a very complete discussion of the 
procedures involved in fitting orthog- 
onal polynomials to a 4X7XK2xX2 
2 factorial design on determination 
of differential limens. 

The purpose of this note is to com- 
ment briefly on this technique and 
show how its use resolves the seeming 
paradox posed by Webb and Lem- 
mon. The principle underlying this 
procedure is that, when a test of 
functional relationship is desired, the 
between SS with k—1 df may be 
analyzed into k—1 orthogonal com- 
parisons, each associated with a par- 
ticular aspect of the regression line. 
ach of these components may be 
tested for significance independently. 
The first component isolated is that 
due to linearity, the second is the 
quadratic component, the third the 
The df associated with 
each of these is 1, and the individual 
MS's are tested against the within MS 
for significance. 

Cases I, II, and V from Webb and 
Lemmon’s original article will be 
discussed with reference to this 
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cubic, ete. 
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method. Cases III and IV have to be 
eliminated since it is necessary, when 
using orthogonal polynomials, either 
to assume that observations are taken 
at equal intervals along the X-axis, 
or else the actual values on the X-axis 
must be known. For Case I there is 
no problem since only two sets of ob- 
servations are taken. In Case II 
Webb and Lemmon assume that 
their C group is midway between 
groups A and B, so equal intervals 
are present here. For Case V inspec- 
tion of the graph seems to indicate 
that the four groups are spaced at 
equal intervals, and that is the as- 
sumption made here. For Cases II] 
and IV it is obvious that the groups 
are not spaced at equal intervals, so 
these cannot be discussed. 

To illustrate the procedure and its 
interpretations, the various groups 
were assigned arbitrary summation 
values (the results would have been 
the same no matter what values were 
assigned), and analysis of variance 
tables were constructed which yield 
F ratios identical with those given 
by Webb and Lemmon. For Case I, 
YA was assumed to be 11 and 2B was 


VICTOR H. DENENBERG 


assumed to be 33. With 11 Ss in each 
group it was simple to determine the 
SS and MS for the between-groups 
variance. Since F=4.35 by Webb and 
Lemmon’s definition, it was possible 
to work back and determine what the 
within A/S and SS had to be to yield 
this F ratio. The same procedure was 
followed for Cases Il and V. For Case 
II, 2A=11, 2B=33, and 2C=22. 
For Case V, ZA=11, 2B=11, ZC 
= 33, and }D=33. Then the be- 
tween SS for Case II was analyzed 
into its linear and quadratic com- 
ponents, and the between SS for 
Case V was analyzed into its linear, 
quadratic, and cubic components. 
The A/S’s were then computed and 
were tested against the within A/S. 
All these data are illustrated in Table 
1. The values which are not in paren- 
theses are the between and within 
sources of variance and are identical 
with Webb and Lemmon’s data. All 
the data which are enclosed in paren- 
theses are the results of the orthog- 
onal polynomial analysis. 

When Case II is analyzed in this 
manner, it is seen, though the over- 
all F test is insignificant, that when 


TABLE 1 


ANALYSIS OF VARIANCE OF Cases I, II, AND V FROM WEBB AND LEMMON’S 
HypPorueTIcAL Data (7) 
Data not in parentheses are from Webb and Lemmon. Data in parentheses are the results 


of the orthogonal polynomial analysis. 


; | 
Case 


Source 


I Between 
Within 


Il Between 
(Linear) 
(Quadratic) 
Within 


Between 
(Linear) 
(Quadratic) 
(Cubic) 

Within 





202.40 
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the linear and quadratic components 
are separated all the between vari- 
ance is explained by the linear regres- 
sion (which would have to be true 
since Webb and Lemmon assumed 
that the mean of their C group fell 
directly on the grand mean). 
there are 1 and 30 df to test the 
linear MS, this linear regression is 
more significant than that for Case | 
where the identical F ratio is found 
but is tested against 1 and 20 df. 
(Case I may also be considered to be 
a test of linearity, since the linear SS 
here is identical with the 


Since 


between 


SS.) This also follows logically since 


we would place more confidence in a 
linear curve determined by 3 points 
than we would in a curve determined 
by only 2 points. 

For Case V it may be seen that a 
highly significant quadratic relation- 
ship exists between the two variables. 
None of the regression is explained by 
the linear or elements; the 
quadratic component accounts for all 
the between variance. Though in 
this case the over-all F is found to be 
barely significant at the .05 level, a 
more accurate interpretation of the 
experiment is obtained from this fur- 
ther analysis. 

This type 


cubic 


of statistical analysis 
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would appear to be profitable in psy- 
chological research. As Webb and 
Lemmon indicate, the situation 
where a functional relationship exists 
between the independent and de- 
pendent variables is a fairly common 
Kogan (4) in his recent review 
of variance designs in psychological 
points out that the pro- 

fitting orthogonal poly- 
nomials will frequently furnish infor- 
mation and 


one. 


research 
cedure of 
answers to questions 
which cannot be obtained by an over- 
all F test to treatment means. How- 
ever, the fact that Kogan only cites 
one psychological study which has 
used this method—that by Johnson 
and Tsao (3)—would indicate that 
this technique has not been widely 
used by psychologists. 

In summary, the author would like 
to point out that a logical analysis of 
the experimental situation must pre- 
cede the selection of a statistical tech 
nique. In the case where FE suspects 
that a functional relationship exists, 
the over-all F test of treatment means 
is not the best test of this relation- 
ship. The use of the method of orthog- 
onal polynomials, however, will per- 
mit /# to make an exact 
hypothesis. 


test of his 
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The problem of evaluating a series 
of statistical tests (e.g., t's, F's, x?’s) 
has recently received the attention of 
psychologists. The general approach 
to the problem is to set the signifi- 
cance level (p) at .05 or .01 and to 
find the chance probability of ob- 
taining at least m significant results. 
This is done by expanding the bi- 
nomial, (p+q)*, where g=1—p and 
N is the number of significance tests 
made. This procedure is applicable 
when prediction of the outcome of a 
statistical test is independent of any 
other tests in the series (8). Wilkin- 
son (14) has published tables for p at 
the .05 and .01 levels showing the 
probability of obtaining or more 
significant statistics out of N calcu- 
Wilkinson's tables, 
however, only run to N=25. Brozek 
and Tiede (1) in a subsequent article 
suggested that when Np is equal to or 
larger than five it is possible to em- 


lated statistics. 


ploy the normal curve approximation 
to the binomial distribution. ‘To do 
this, the critical ratio is calculated by 
means of the formula 


tS 
CR = - — 


g 


where M=Np, ¢=./Npq, and —.5 
is the correction for discontinuity. 
The probability value is obtained 
from the table of area under one tail 
of the normal curve. To use this 
normal curve approximation, how- 
ever, N must be 100 or larger when 
p is taken as .05, or 500 or larger 
when p is taken as .01, since it will be 
remembered that Np must be equal 
to or larger than five. 
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Jetween 


Wilkinson’s tables and the normal 
curve approximation there is a gap 
which we feel should be filled in. 

The graphs which we provide here 
run to N=100 for p=.05 (Fig. 1) and 
N=500 for p=.01 (Fig. 2) and can 
be used when the normal curve ap- 
proximation is not applicable. To use 
the graphs, the .05 or the .01 level of 
confidence is selected and the number 
of calculated statistics (NV) and the 
number of significant statistics () at 
the chosen level of confidence are 
counted. The chance probability of 
obtaining at least m out of N sta- 
tistics can be read off the graph for 
values between .001 and .50. N has 
been plotted on a logarithmic scale, 
and this fact should be taken into 
account in interpolating for values of 
N. ‘kor example, for n=7, N=60, 
and p=.05 chance probability can be 
read from lig. 1 as lying between .05 
and .01. One would conclude that it 
is not probable that obtaining seven 
significant results out of 60 was due 
to chance alone. On the other hand, 
there is still the possibility that 
several of the seven significant sta- 
tistics might have occurred by chance 
alone. 

The current practice of tabling 
critical values of t's, F’s, x?’s at the 
.05 and .01 levels of confidence makes 
the counting of significant statistics 
at these levels and the use of the 
binomial distribution the most suita- 
ble approach to the problem of test- 
ing the significance of a series of sta- 
tistical However, there are 
two types of situations in which our 
graphs will be inadequate. The first 
is one in which the level of signifi- 


tests. 
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Fic. 1. CHANCE PROBABILITY OF OBTAINING AT LEAST n STATISTICS SIGNIFICANT AT THE .05 
LEVEL FROM N CALCULATED STATISTICS 


cance one desires to adopt is not .05 
or .01, but, for example, .10 or .001. 
There are at least three ways of 
handling this situation. The first is 
to consult tables of binomial distribu- 
tions. The U. S. National Bureau of 
Standards (16) has published tables 
for p ranging from .01 to .50 and N’s 
up to 50, and Romig (12) has pub- 
lished tables for N’s from 50 to 100. 
A second method is to calculate the 
desired binomial distribution directly, 
using a calculating machine and a 
convenient working formula (9, pp. 
22-23). A third method is to use the 
Poisson distribution as an approxi- 


mation to the binomial distribution 
(4). When Np is taken to be less than 
five (the range within which the 
normal curve approximation is not 
applicable) and p is taken to be not 
larger than .10, the approximation of 
the binomial distribution by the 
Poisson is fairly good even for values 
of N as small as two. We have found 
that with these restrictions the larg- 
est absolute error in calculating cu- 
mulative probabilities is .02, and in the 
critical area of cumulative probabili- 
ties of .10 or less the error is not 
larger than .012. Soper (13), Molina 
(10), and Hartley and Pearson (7) 
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have published tables of Poisson dis- 
tributions, and Dixon and Massey (3) 
include an abridged Poisson distribu- 
tion in the appendix of their book. 

A second type of situation in which 
our graphs will not be adequate is one 
in which exact probabilities are cal- 
culated for a number of significance 
tests and a sensitive test of over-all 
significance of the series is desired. 
Fisher (5) offers a method of combin- 
ing exact probabilities from a series of 
tests of significance. His test is based 
on the formula for the probability of 
a chi square with two degrees of free- 
dom. Using this formula it is possible 
to transform p values to chi-square 
values. Using common logarithms, 


x? = 2-2.302585(—logio p). 


Independent chi squares and _ their 
degrees of freedom (two for each chi 
square) can be summed and _ these 
sums referred to a chi-square table 
for a combined probability value. 
For an example which is worked out, 
interested readers are referred to 
Fisher (5, pp. 99-101) or to the arti- 
cle by Jones and Fiske (8). 

To use this method exact probabili- 
ties of t’s, x?’s, and F’s are needed. 
Good approximations of exact proba- 
bilities can be obtained by linear in- 
terpolation in available tables of t and 
x? by first expressing probabilities in 
natural or common logarithms. Since 
Fisher's chi-square technique calls for 
exact probabilities expressed in loga- 
rithms, the values found by interpo- 
lation need not be transformed to 
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their antilogarithm equivalents. The 
same procedure applies to F, with the 
additional step of transforming F to 
square root of F before making the 
linear interpolation. The usual pub- 
lished tables of F do not allow for 
interpolations for p values below .05. 
However, Hald (6) in his Statistical 


Tables and Formulas includes F dis- 
tributions for critical p values of .10, 
.30, and .50. Exact p values for F's 
can also be calculated from the in- 
complete beta function tabled by 
Pearson (11), and readers are referred 
to Burke’s (2) article explaining this 
procedure, 
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COMMENTS ON SEEMAN’S OPERATIONAL ANALYSIS OF THE 
FREUDIAN THEORY OF DAYDREAMS 


RICHARD A. BEHAN AND FRANCES L. BEHAN 
Michigan State College 


While the present writers are in 
wholehearted agreement with Dr. 
Seeman’s remark that formal opera- 
tional analysis is an indispensable pre- 
requisite to empirical investigation, 
it is also true that the results of the 
analysis, once it is completed, need to 
be criticized. After one has ab- 
stracted the formal structure of a 
theory, it is necessary to subject this 
formal structure to logical criticism. 

The first criticism is concerned 
with the restatement of the Freudian 
assertion that daydreams are wish- 
fulfillments. The actual restatement 
is as follows: “The emission of a day- 
dream is functionally related to a spe- 
cific type of demand (wish), the rela- 
tion being such that whenever an in- 
stance of such and such a daydream 1s 
observed, it is required by the theory 
that an instance of a specified corre- 
sponding demand (wish) must be iden- 
tified by a suitable objective operation” 
(2, p. 377). Dr. Seeman then goes on 
to say: “It seems clear that, so 
stated, the theory really requires the 
occurrence of identifiable, lawful pat- 
terns of demand-daydream covaria- 
tion.”” The point to be made here is 
that this restatement is not a state- 
ment in theory at all; it is, rather, 
metatheory. That is to say, the re- 
statement is a_ statement about 
theory, not a statement im theory (4). 
If the quoted statement were actually 
theory, it would be an assertion of a 
specific functional relation. There are 
many different functional relations 
which fit the description given in the 
quoted statement. 

Second, the theory does not require 
“the occurrence of identifiable, law- 
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ful patterns of demand-daydream co- 
variation.”’ The theory ts the set of 
statements which assert ‘“identifia- 
ble, lawful patterns of demand- 
daydream covariation.’’ Every em- 
pirical theory consists of statements 
which assert identifiable, lawful pat- 
terns of construct phenomena covari- 
ation. This is required of the theory, 
not by the theory on purely methodo- 
logical considerations. 

Third, on page 377, Dr. Seeman 
asserts: ‘What is crucially important 
here is the understanding of the con- 
tingent notion of frequency, which lies 
buried in this analysis of the meaning 
of the concept of wish-fulfillment.” 
Then on page 379, he asserts that Q 
the hypothesis that is predicted by 
the theory—is a predicate. Now, a 
predicate, with its argument, is a 
two-valued constant (not a many- 
valued functor); it is either true or it 
is false. It is not possible, with the 
predicate Q analyzed as it is, to pre- 
dict anything about the frequency of 
daydreams. 

It is well to add in passing that Dr. 
Seeman is not the only psychologist 
who has confused statements about 
theory for statements in theory in 
this respect. There is, as it were, a 
great deal of precedent in modern 
psychological “theorizing” for calling 
statements of this sort theory. 

The next point for consideration 
concerns the inductive leap from 
(PDQ)-Q to (P). According to foot- 
note 7 (2, p. 378) the symbolized 
statement is ‘‘an extremely elemen- 
tary application of symbolic logic.” 
This is not the case. The symbolized 
statement is an extremely elementary 
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operation excluded in symbolic logic 
—known as the fallacy of asse rting the 


consequence (1, pp. 7-8). 

The reasons that we wish to ex- 
clude formal fallacies from our the- 
ortes may be summed up as follows: 
A fallacy is a false form of statement. 
It is a well-known theorem in sym- 
bolic logic that a false statement im- 
plies any statement (3, p. 104). Now, 
it is the case that statements assert- 
ing both sides of every question about 
which any theory makes an assertion 
are included in the class of all state- 
ments (the including every 
statement). Therefore, the theory 
which contains even one fallacy will 
predict both sides of every question 
about which it contains an assertion. 
There are three results of this state of 
affairs which are worth mentioning: 
(a) The theory is never wrong—it 
always predicts what is in fact the 
case, along with what is not the case. 
(b) The theory makes no unequivocal 
assertion, and the theorist must al- 
ways wait until after the fact to find 
out what his theory would predict. 
Thus, prediction is always of an ad 
hoc nature. (c) The theory is useless. 
Any procedure which purports to be 
the result of the use of the theory 
could proceed just as well without it. 

The next point for consideration 
concerns the discussion of the sen- 
tence [(P-P’;...4) DQn...%]-[Q]. 

On page 379 Dr. Seeman states 

. in those isolated instances... 
where the confirmation conditions 
indicate that ~@Q is the case, the in- 
dication would be for a re-examina- 
tion of P’ before P.”” With this point 
of view we disagree. 


class 


“e 


Whenever a 
statement derived from an empirical 
theory is disconfirmed the theory it- 
self is denied. The only way out is to 
show that the theory does not predict 
the state of affairs that was discon- 
firmed. 

With the help of symbolic logic it is 
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easy to show that it is P that is false 
when one discovers a disconfirmation 
of the theory. There are two cases, 
namely: (a) P’ asserts a fact; (6) P’ 
asserts an assumption (2, p. 379). 
Consider the first case: If it were 
true that P’ asserts a fact, then P’ 
cannot be false. After all, if P’ 
asserts an actual state of affairs, it 
can only be true. The theory asserts 
that (P-P’) implies Q. We find ~Q; 
therefore, by Modus Tollens, we de- 
duce ~(P-P’). But P’ is true; 
therefore, P must be false (1, ; 25). 

Consider the second case: as- 
serts an assumption; i.e., P’ is an in- 
stance of P. The logical model for 
this situation is the reference formula 
known as Specification (Spec., see 1, 
p. 354). Applied to our situation 
Spec. asserts that P is a universal 
assertion that implies P’. It goes al- 
most without saying that the uni- 
verse of discourse here is the circum- 
scribed universe in which the theory 
under consideration applies. Since P 
implies P’, and we have ~P’, we 
may, by the reference formula known 
as Modus Tollens, deduce ~P. 

It is thus seen that the occurrence 
of a nonconfirmation (~@Q) leads in 
every case to the denial of the theory. 
There is no way to save a theory tf it 
actually predicts wrong; one can only 
change 1t. 

The present writers hope that the 
reader will not feel that they disap- 
prove of what Dr. Seeman has tried 
to do. On the contrary, it is felt that 
Dr. Seeman has accomplished two 
important things: (a) He has pro- 
vided the first (to our knowledge) 
attempt to demonstrate the logical 
form of the Freudian theory of day- 
dreams. (b) He has stated the results 
of his analysis in such a way that one 
can unequivocally determine its logi- 
cal characteristics. 

The 


closed 


comments will be 
with a few words about the 


present 
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implication of Dr. Seeman’s analysis 
for the Freudian theory of day- 
dreams. If Dr. Seeman’s analysis is 
correct, then all of the remarks which 
were made earlier, with reference to 
theories which contained fallacies, 


are applicable to the Freudian theory 


WILLIAM SEEMAN 


of daydreams. These remarks were: 
(a) The “theory” predicts both sides 
of every question. (6) The ‘‘theory”’ 
is of an ad hoc nature. (c) The ‘‘the- 
ory”’ is useless; any procedure which 
purports to follow from the ‘‘theory”’ 
could proceed just as well without it. 
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REPLY TO THE BEHANS 


WILLIAM SEEMAN 
Mayo Clinic 


In connection with the Behan 
paper, I shall confine myself to a few 
brief comments. 

1. The Behans’ doctrinaire state- 
ments about theory suggest a con- 
fusion of logical fact with methodo- 
logical decision, especially with the 
notion of what Reichenbach calls 
“entailed decisions” (5, pp. 11-15). 
The impression conveyed in their 
paper that their remarks on theory 
are in accord with Woodger (6) is also 
erroneous. Actually, they are in dis- 
agreement with Woodger; and the 
“specimen theory” he presents (and 
which he therefore, presumably, con- 
siders acceptable as ‘‘theory’’) would 
be ruled out by the criteria set out in 
the Behan paper. 

2. It is not true that I have com- 
mitted the fallacy of asserting the 
consequent. Given “If ‘P’ then ‘Q’ 
and assert ‘Q’ ”’ it would be asserting 
the consequent if and only if I were 
to say “assert ‘P’ to be true on the 
basis of ‘Q.’ ’’ But my paper does not 
say that; what it says specifically is 
“inductive leap to ‘P,’ ’’ and this on 


the assumption that it would be un- 
derstood as a convenient shorthand 
for something like ‘‘accept ‘P’ pro- 
visionally as a proposition in the 
larger theory until such time (if any) 
that there is sufficient evidence to 
controvert it and render it useless in 
the theory.” To call this ‘asserting 
the consequent”’ is to say either that 
all experimental procedure leads to 
this fallacy or to assert a stricture 
against all empirical science. And 
this, | presume, is what MacCorquo- 
dale and Meehl have in mind when 
they write ‘All scientific hypothesiz- 
ing is in the invalid ‘third figure’ of 
the implicative syllogism’”’ (4, p. 97). 
What purpose, after all, can an ex- 
periment serve if, from the results, 
one is forbidden to make inferences? 

3. With respect to the deductions 
which the Behans characterize as 
‘“‘impossible,”’ the most effective refu- 
tation, it seems to me, lies in the sim- 
ple fact that the deductions have 
been done. To carry out an experi- 
mental test of this I used a group of 
eight professional logicians and six 
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experimental psychologists. They 
are in agreement in performing the 
‘impossible’ deductions. 


4. The Behans obviously have con- 


fused material implication with logi- 
cal implication.! 

5. Their use of the formula Spec. is 
erroneous. This formula is not in the 
sentential calculus (e.g., PDQ), but 
in the logic of quantifiers, e.g., 
x(FxDGx);on this, see Quine (3, pp. 
17-18, ch. 2). 

6. The best comments the 
‘“‘proof”’ of the consequences of non- 
confirmation for any theory are to be 
found in Ayer and Cohen and Nagel.” 

7. The Behan paper is guilty of in- 
valid inference. Specifically, in the 
final paragraph their conclusion 
would be formally valid if and only if 
there were a true additional premise 
“and everything we have said is fac- 
tually true and formally correct.” 


on 


1 This confusion is evident in their equating 
material implication with prediction, after 
stating the ‘well-known theorem.” It is not 
true that a false statement /ogically implies 
any statement, and hence it does not predict 
at all. The “well-known theorem” is a 
theorem in the calculus of propositions and it 
states that a false statement materially implies 
any statement. To equate this with predic- 
tion leads to absurdities which I shall demon- 
strate ina moment. The distinction between 
these two kinds of implication is given by 
Cohen and Nagel follows: 
Logical implication “involves no assumption 
as to the factual truth or falsehood of either 
of two propositions, but only that they are so 
connected by virtue of their structure... 
that it impossible for the implicating 
proposition to be true and the implied one to 
be false”’ (2, p. 127). It is quite different with 


somewhat 


as 


1s 
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material implication, which is “the name we 
give to the fact that one of a pair of proposi- 
tions happens to be false or else the other hap- 
pens to be true” (2, p. 128). Of material im- 
plication Quine says: “This relation is so 
broad as not to deserve the name implication 
"3, p. 29 

The most effective way of demonstrating 
the consequences of this confusion is to exhibit 
its absurd results. Allowing the ‘well-known 
theorem” to formulate a prediction would lead 
to permitting a statement like the following: 
‘Two plus two equals five predicts that Sacco 
and Vanzetti were executed for murder and 
\lfred Smith was defeated for the presidency 
in 1928 predicts that the base angles of an 
isosceles triangle are equal” (2, p. 127). Read- 
ers conversant with symbolic logic will have 
noticed that this is the same error which I 
committed in my 1951 Had the 
Behans singled this out as a major error and 
should have had no choice but 
A second error was my failure to 
the sentential calculus does not 


paper. 


confusion | 
agreement 
that 
provide the resources for the formulation of a 
psychological theory (3, pp. 17-18, 65-71). 
This same error is also perpetuated in the 
Behan which accepts the sentential 
calculus as the basis for argument. 

2 On this point Ayer and Cohen and Nagel 
\yer writes that, in the 
case of a noncontirming event, ‘‘we may con- 
clude that the [theory] is invalidated by our 
experiment. But we are not obliged to adopt 
this conclusion {italics mine]. If we wish to 
preserve our [theory] we may do so by aban- 
doning one or more of the other relevant hy- 
(1, p. 94). Cohen and Nagel take 
the same position: ‘“The logic of the crucial 
experiment, therefore, is as follows: If [1 
(theory) and K (assumptions) then p;. But 
p is false; therefore either H, is false or K (in 
completely) is false’ (2, p. 220). 
who may wonder how it was 
“easy"’ to demonstrate the reverse of this 
“with the help of symbolic logic’’ will find the 
answer in the previous paragraph; i.c., the 
Behans applied a formula from the calculus of 
quantifiers to a case in the sentential calculus. 


realize 


paper, 


are quite explicit 


potheses” 


part or 


Readers so 
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SPECIAL REVIEW 
AN EVALUATION OF THE ANNUAL REVIEW OF 
PSYCHOLOGY (VOLUMES I-IV)! 
LYLE H. LANIER 
University of Illinois 


One consequence of the postwar ex- 
pansion of professional psychology— 
as science, as education, and as prac- 
tice—has been an increasing volume 
of literature in all its branches. Beset 
by growing scientific specialization 
and professional diversification, psy- 
chologists individually have had de- 
creasing time and competence to give 
to the assimilation of this profusion 
of publication. The important func- 
tions of review, evaluation, and syste- 
matization have lagged seriously be- 
hind the accumulation of articles, 
monographs, and books. Whether or 
not this material really represents a 
single universe of scientific discourse 
or can be transformed into a unified 
conceptual structure have been ques- 
tions of mounting concern to psy- 
chologists. 

Into this state of growing confusion 
the Annual Review of Psychology was 
introduced in 1950. It ‘“‘was con- 
ceived as a supplement to, rather 
than a duplication of, other publica- 
tions presenting abstracts or rela- 
tively long-term reviews of psycho- 
logical literature . . . to present crit- 
ical appraisals of current research 
and theory in psychology on an an- 
nual basis in the case of the most 
active and general fields and on a bi- 


1 STONE, CALVIN P., & TAYLOR, DONALD W. 
(Eds.) Annual review of psychology. (4 vols.) 
Stanford, Calif.: Annual Reviews, Inc., 1950, 
1951, 1952, 1953. Two of these volumes have 
been previously reviewed in this JOURNAL: 
Vol. 1 by H. H. Kendler in 1951 (pp. 159-161) 
and Vol. 3 by M. H. Marx in 1952 (pp. 657- 
660), 
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ennial basis for fields of lesser activity 
or scope.”’ Four volumes have now 
appeared, edited by Calvin P. Stone 
with Donald W. Taylor as associate 
editor. The purpose of the present 
review is to evaluate this series as a 
whole, and to comment in particular 


upon Vol. 4. 


GENERAL APPRAISAL OF THE SERIES 


Although the Annual Review is 
widely known among psychologists, 
there are probably many who do not 
know in detail what the series has 
contained and who the contributors 
have been. Both for this reason and 
for its uses as a framework for the 
present review, a summary of infor- 
mation concerning all four volumes 
is presented in Table 1. 

Size and bibliographic scope. The 
Annual Review has grown from 330 
pages in 1950 (including indices) to 
485 1953—an increase of 
This increase in 
length has roughly paralleled the 
number of references cited. In 1950 
there were 1,594 titles in the eighteen 
chapters, while in 1953 the number 
was 2,003 for nineteen chapters. The 
gross increase was 38 per cent, while 
the average increase per chapter was 
about 25 per cent (from 89 to 111). 

There are interesting differences 
among the authors in the number of 
references cited, both for different 
reviews of the same topic and for 
reviews of different topics. For exam- 
ple, Sears in 1950 listed only 39 
articles on personality, while Bron- 


pages in 
about 47 per cent. 
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TABLE 1 


SUMMARY OF CONTENTS OF Annual Review of Psychology 





Volume 1 


Topic _— —— — 





Devel., child 


Learning 
Vision 
Hearing 
Somes., chem. 
Ind. diff. 
Personality 


Social 
Industrial 


Jones & 8 Barker 
Bayley 
Melton 
Bartlett 169 
Newman 105 
Geldard 62 
Thorndike 
Sears 


38 
101 Buxton 
Chapanis 
Wever 
Pfaffmann 
Tyler 
MacKin- 

non 
Katz 
Bellows 


Bruner 
Shartle 
Comparative & Hebb 
physiological 
Abnormal 
Clinical: diagn. 
Clinical: therapy 
Educational 
Counsel.: diagn. 
Counsel.: therapy 
Statist., design 
Problem solving 
Gerontology 
Motivation 
Spec. disabil. 
Theoret. psych. 


Deese & 
Morgan 
Taub 
Challman 
Pepinsky 
Stroud 
Stuit 
Pepinsky 
Edwards 


Shock 


Cameron 
H. Hunt 
Snyder 
Cronbach 
Berdie 
Bordin 
Grant 
Johnson 


Volume 2 


Author Pp. Refs. Author Pp. Refs. Author Pp. 





Volume 3 Volume 4 
Author Pp. Refs. 


Refs. 
136 





22 Nowlis & 
Nowlis 
22 Harlow 
20 Helson 
14 Garner 20 
16 Wendt 26 
18 Humphreys 20 
24 7 Eysenck 24 


28 Harris 


26 
30 


Underwood 
Vernon 
Licklider 
uch 
Anastasi 
Bronfen- 
brenner 
Newcomb 
Harrell 


36 Smith 30 
Brown & 28 
Ghiselli 
Nissen & 28 
Semmes 
Zubin 22 
Magaret 38 
Raimy 30 
Elmgren 28 


Gilbert 30 
McNemar 10 


Hess 
Neff 
White 
Rotter 
Sanford 
Carter 


Williamson 
Mosteller 


Mowrer 20 


Cobb 
Bergmann 





fenbrenner cited 111 in 1953. By 
contrast, Cameron mentioned 142 
references in his 1950 discussion of 
abnormalities of behavior, while 
White listed 75 in 1953. Such varia- 
tions are, of course, very difficult to 
interpret since authors differ greatly 
in the extent to which evaluation or 
even individual mention is made of 
numbered references. 

The number of references cited in 
Vol. 4 is roughly 25 per cent of the 
number of entries in the Psychologt- 
cal* Abstracts for 1952. The%signifi- 
cance of this percentage is by no 
means clear, however, since the Psy- 
chological Abstracts cites many in- 
formational and ‘“‘professional’’ con- 
tributions which would not properly 
come within the purview of the An- 
nual Review. It also includes many 
articles in related fields which would 
not normally be included in an an- 
nual review of psychology. Moreover, 
the undetermined amount of dupli- 
cation among the references in the 
Annual Review would inflate this 
gross index of “bibliographic cover- 


age. 





It is of some interest to compare 
quantity of literature reviewed in the 
Psychological Bulletin with that 
covered in the Annual Review. In 
1950 some 1,363 titles were cited in 
articles and book reviews in the Psy- 
chological Bulletin, while the Annual 
Review listed 1,594 references. In 
1953 the comparable figure for the 
Bulletin was 1,322 while that for the 
Annual Review had increased to 
2,003. These numbers are not, of 
course, commensurable in any strict 
sense, partly because of the differing 
objectives of the two publications and 
the undetermined amount of duplica- 
tion among the references in each of 
them. 

Topical organization. |t is to the 
chapters concerned with “basic’’ psy- 
chological science that one turns for 
the Annual Review's ‘systematic 
psychology’’—its conceptual organi- 
zation of the scientific subject matter 
of the discipline. Such chapters com- 
prise approximately two-thirds of 
each volume. The topics fall into 
quite heterogeneous categories. Cer- 
tain chapters are focused upon classes 
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of “primary’’ dependent variables 
as subject matter—general modes of 
behavior such as seeing, hearing, 
learning, and problem solving. An- 
other set of chapters is organized in 
terms of ‘‘secondary’’ dependent vari- 
ables such as indices of abilities, per- 
sonality characteristics, and patterns 
of social behavior. A third set of 
chapters is concerned with different 
types of behaving subjects—animals, 
children, the aged, the disabled, the 
abnormal. The material on physio- 
logical psychology is partly a mis- 
cellany, but its distinctive ‘‘syste- 
matic’’ concern would seem to be 
with the influence of a set of inde- 
pendent variables upon a wide variety 
of behavioral functions. In this re- 
spect it is similar to those aspects of 
social psychology which consider the 
effects of social and cultural condi- 
tions upon the behavior variables 
serving as systematic categories for 
other levels of psychological analy- 
sis. 


By and large, this multidimension- 
ality of ‘‘chapter headings” is typical 
of the general state of contemporary 


systematic psychology—a_ state of 
essentially ‘“‘logic-tight’’ compart- 
ments insofar as formal conceptual 
relations go. ‘The editors of the 
Annual Review take the field pretty 
much as they find it, and apparently 
make little direct attempt to change 
it towards greater logical or psycho- 
logical order. This judgment is not 
necessarily a criticism of a publica- 
tion such as the Annual Review. It 
would be difficult for the editors to 
do otherwise than present psychology 
in terms of the ‘chapter headings,” 
the clusters of scientists, and the 
classes of institutions which underlie 
the confused mosaic of contemporary 
psychology. Scientific writers prob- 
ably work more easily (and willing- 
ly!) on tasks defined in terms of famil- 
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iar concepts and preferred categories. 
A related consideration is the fact 
that the literature tends to be or- 
ganized in these terms (for example, 
in the Psychological Abstracts) and 
hence is more easily surveyed than 
would be the case if an idiosyncratic 
framework for systematic evalua- 
tion were established by editorial fiat. 
Finally, practical considerations 
make it virtually impossible for the 
editors to achieve any kind of ex 
post facto editorial coordination or 
integration among the several con- 
tributions. There is insufficient time 
between the submission of the manu- 
scripts by the authors and the publi- 
cation of the volume to accomplish 
much more than routine editorial 
emendation of the material. The 
various chapters cover the literature 
up to within six to seven months of 
the publication date of a given vol- 
ume. To complete the writing, edit- 
ing, and printing within such a period 
is a remarkable achievement in any 
case. 

Nevertheless, it is unfortunate 
that certain focal points of contem- 
porary psychological discussion are 
largely lost within the present topical 
structure of the Annual Review. Per- 
ception and motivation are exam- 
ples. Volume 3 has a chapter on moti- 
vation, but none of the four volumes 
has had one on perception. Most of 
the important literature in these areas 
has probably been reviewed under 
other headings, but there have not 
been the continuing, unified com- 
mentaries upon the work in these 
fields which their importance in con- 
temporary psychological thinking jus- 
tifies. Perhaps the heterogeneous 
material in either of these fields could 
not be transformed into anything 
resembling a unified body of knowl- 
edge. But it is precisely because of 
the confusion as to the meaning and 
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systematic status of such terms that 
continuing efforts at critical method- 
ological appraisal of their usage in 
research and theory would be valu- 
able. 

More extensive, independent treat- 
ment of such topics as perception, 
motivation, and symbolic behavior 
would add, of course, to the length of 
a volume of the Annual Review. If 
compensating reductions had to be 
made they might well affect the ‘‘psy- 
chophysiological” literature. Each 
of the four volumes has had three 
chapters devoted to sensory processes, 
whereas for perception, motivation, 
and thinking only the last two have 
appeared once each in single volumes 
(see Table 1). Together with special 
treatment of ‘‘physiological psychol- 
ogy,’ this pattern of differential em- 
phasis overstresses psychophysiologi- 
cal literature at the expense of strictly 
‘“‘psychological”’ material. The physi- 
ological bias is most pronounced in 
the chapters on somesthesis and the 
chemical senses. A check of the 
publication media represented in the 
bibliographies of two of these four 
chapters (Vols. 2 and 4) shows that 
approximately 80 per cent of the 
references are to be found in physi- 
ological and medical publications. 
Less frequent review of this literature 
would make space available for more 
adequate consideration of topics of 
greater significance to psychology as 
a whole. 

The reviewers of Vols. 1 (Kendler) 
and 3 (Marx) in this JOURNAL 
thought that the several chapters de- 
voted to clinical psychology and 
counseling should have been con- 
densed and integrated. A _ single 
chapter for psychodiagnosis and an- 
other integrated chapter for psycho- 
therapy has been the usual proposal 
for condensing these reviews. There 
certainly is overlap among the prob- 
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lems and techniques used, respec- 
tively, in ‘‘clinical psychology”’ and 
in ‘“‘counseling.’’ Indeed, this is a 
prominent subject of discussion by 
several of the reviewers, mainly those 
in the counseling area who are trying 
to find a distinctive definition of their 
field. But there are significant dif- 
ferences between these two fields in 
terms of literature cited in the Annual 
Review. For example, Gilbert’s single 
chapter on counseling methods in 
Vol. 3 lists only 23 of the 196 refer- 
ences in Magaret’s chapter on ‘‘clini- 
cal” psychodiagnostics and only 11 
of the 79 references in Raimy’s chap- 
ter on psychotherapy. The compa- 
rable figures for Vol. 4 show even less 
overlap: Williamson’s “counseling” 
chapter includes only 17 of the 115 
references cited in Rotter’s review of 
“clinical” psychodiagnostics, and 
only two of Sanford’s 68 references 
in the chapter on “‘clinical’’ therapy. 
To a considerable extent, of course, 
the degree of relative bibliographic 
independence may have been due to 
deliberate effort to avoid unneces- 
sary duplication. Nevertheless, these 
figures, together with substantive dif- 
ferences between the parallel treat- 
ments, suggest that “‘clinical’’ and 
“counseling” psychologists at pres- 
ent have less over-all professional 
communality than the formal re- 
semblances of their methodologies 
and underlying principles would seem 
to indicate. It might be added that 
in Vol. 5 the editors plan to have a 
single chapter on theory and _ tech- 
niques of assessment, one on psycho- 
therapy and one on counseling meth- 
ods. ‘This arrangement is a step in 
the direction of “integration”? and 
yet it will allow for special considera- 
tion of whatever distinctive problems 
and techniques there might be in 
the nonclinical aspects of counseling. 

Evaluative character. The pattern of 
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topical organization provides only the 
structural framework for the ap- 
praisal of the literature. Other im- 
portant determiners of the success of 
an annual review are the selection of 
contributors, the formulation of the 
reviewing task, and constructive ac- 
ceptance by the reviewers of the task 
defined. Concerning the contribu- 
tors, the list of authors in Table 1 is 
evidence that the editors have in gen- 
eral succeeded in securing psycholo- 
gists from whom outstanding evalua- 
tions of the literature would be ex- 
pected. ‘The pessimists who pre- 
dicted that the Annual Review would 
fail to recruit a continuing force of 
first-rate contributors were wrong— 
so far as these four volumes go. 
With respect to definition of the 
task, the preface to Vol. 1 states: 
“They [the authors] were at liberty 
to indicate their points of departure 
by citing summaries of basic work 
prior to the review period but were 
advised not to strive for mere com- 
prehensiveness, especially in the form 
of a loosely integrated series of ab- 
stracts of all the current literature. 
On the contrary, the editorial board 
asked that they adopt an interpreta- 
tive and evaluative approach to the 
literature they selected for review.” 
Thus the editors clearly foresaw the 
danger that the reviews might de- 
generate into unorganized _ biblio- 
graphic digests. They appeared to 
recognize also that certain of the re- 
views in Vol. 1 had failed to avoid 
that danger, since they remark fur- 
ther: ‘‘While it appears that all fields 
are not equally amenable to this ap- 
proach, it is hoped that future vol- 
umes of the Review will reflect gains 
in the techniques of exposition and 
interpretation of the desired kind.”’ 
To what extent have the authors 
been able to achieve the general ob- 
jectives set for them by the editorial 
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board? Have successive volumes 
shown improvement in the ‘‘tech- 
niques of exposition and interpreta- 
tion?’ Are there persistent differ- 
ences among fields in the ‘evaluative 
character”’ of the reviews? In the 
attempt to answer these questions, I 
devised a procedure for appraising 
individual chapters in terms of three 
sets of presumably desirable char- 
acteristics: (4) an introductory orien- 
tation which defines the field and 
establishes a general methodological 
setting for the review; (b) explicit 
indication of the author’s ‘“‘syste- 
matic’’ approach to the field, includ- 
ing the rationale for his topical or- 
ganization and bases of selection 
among references; (c) interpretative 
and evaluative comments upon the 
literature, including a summary 
assessment of over-all achievements 
and trends (e.g., in methodology, 
in empirical knowledge, in theory, in 
technology——as appropriate). In the 
effort to simplify the difficult judg- 
mental task, the appraisals were re- 
stricted to “‘factual’’ estimates as to 
whether or not (for the first two cri- 
teria) and to what extent (for the 
third) the chapters exhibited these 
characteristics. As far as possible, 
differences in quality of writing, in 
technical sophistication, and in valid- 
ity of argument were disregarded. 
The results of these appraisals are 
represented by the figures in Table 2. 
In general, it appears that about one- 
third of the 63 chapters common to 
the four volumes lack the kind of 
“orientational’’ introduction’ de- 
scribed above. More than half of 
them omit any explicit discussion of 
the reviewer's ‘‘systematic’’ analysis 
or organization of the field. One- 
fourth have little or no interpreta- 
tion or evaluation of the literature re- 
viewed. These generalizations are 
subject, of course, to whatever quali- 
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TABLE 2 
RESULTS OF RATINGS OF CHAPTERS FOR 


“ORIENTATION,” ““SYSTEMATIZATION,”’ 
AND “INTERPRETATION-EVALUATION’'* 


Volume 
Classification 


No. of chapters with- 
out “orientation” 
No. of chapters with- 
out “systematic” 
rationale 
Extent of interpreta- 
tion and evaluationt 
Median rating 
No. of chapters 
rated 1 or 2 5 6 


* The chapters common to all four volumes were in- 
cluded, as well as those condensed or expanded in the 
last two volumes (see Table 1). 

t The chapters were rated on a 7-point scale 
“‘1"’ represented the minimal and ‘'7” 
gree of “interpretation-evaluation.” 


7 in which 
the maximal de 


fications might be required by the 
unreliability of the method and by 
possible idiosyncrasies in this single 


reader’s standards of judgment. 
The editors’ hope for improvement 
in future volumes—expressed in Vol. 
1—appears to have been fulfilled, if 
the figures in Table 2 can be accepted 
as evidence. Clearly, Vols. 3 and 4 
excel the first two in estimated degree 
of interpretation and evaluation, with 
Vol. 3 standing highest and Vol. 2 
lowest in this respect. Two mitigat- 
ing circumstances in behalf of Vols. 
1 and 2 should perhaps be noted: (a) 
the writers of the later volumes could 
profit by seeing the earlier ones and 
from critical reactions to them on the 
part of the editors and other critics; 
(b) the last two volumes are consider- 
ably longer, thus presumably making 
more space available for evaluative 
commentary. The weight of these 
considerations is reduced, however, 
by the fact that individual reviews in 
Vols. 1 and 2 are rated just as high 
as those in Vols. 3 and 4. The incli- 
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nation and critical capability of the 
individual author are probably the 
principal determiners of the vari- 
ance among reviews in evaluative 
character. 

There might, nevertheless, be dif- 
ferences among fields in ‘‘ameuabil- 
ity’ to the kind of reviewing in ques- 
tion, as the editors have suggested. 
Although not conclusive evidence for 
such a question, my individual rat- 
ings show that the reviews of the 
applied fields are less ‘‘systematic”’ 
and “evaluative” than those in the 
strictly scientific areas. Again, how- 
ever, the intragroup differences are 
much greater than the average dif- 
ferences between the groups. Cer- 
tain of the reviews in clinical psy- 
chology stand as high by our criteria 
as those in any other field, in contrast 
to the reviews of industrial psychol- 
ogy. With such a broad range of 
application of techniques from so 
many branches of psychology, the 
literature in the latter field is quite 
heterogeneous, and many of the 
studies highly ‘‘atomistic’’ in 
nature. Integrative evaluation and 

stematization are obviously easier 
t ‘mplish in an applied field such 
as Clinical psychology where the ma- 
terial is organized more definitely in 
relation to general principles and 
theory. 


are 


VOLUME 4—1953 


With its nineteen chapters and 485 
pages (including indices), this largest 
member of the Annual Review family 
presents one innovation which will be 
welcomed by most psychologists: the 
inclusion in several of the bibliogra- 
phies of the full titles of all references. 
This option was apparently avail- 
able to all authors but was exercised 
by only seven of them. (It is dis- 
appointing to find that the chapter 
on special disabilities follows the 
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Annual Review's original practice of 
numbering references in the order of 
citation in the text.) 

There are two “‘special’’ reviews: 
a chapter by Bergmann on theoreti- 
cal psychology and one by Cobb on 
special disabilities. Otherwise, the 
organization of topics remains es- 
sentially what it was in earlier vol- 
umes (see Table 1). There are sepa- 
rate chapters on comparative and on 
physiological psychology in place of 
the former combined chapter, and 
counseling continues to have a single 
chapter as in Vol. 3. In general, 
Vol. 4 is a very impressive addition 
to the evaluative literature of psy- 
chology. 

Child psychology. In contrast to 
Barker's soul-searching analysis of 
the uncertain and declining state of 
this field in Vol. 2, Harris presents a 
picture of buoyant empiricism, docu- 
mented by the longest bibliography 
in the book. With so much to write 


about, he doesn’t worry over the 
difficulty of defining the field rigor- 
ously—in contrast to previous re- 


viewers. He is mainly concerned to 
report upon the 160 studies in the 
bibliography, in the form of brief 
summaries of method and results. 
There is little evaluation or*system- 
atic interpretation, and the organ- 
ization of the material is poor. 
Learning. Underwood's review 
continues the generally high level of 
previous reviews in this field—par- 
ticularly with respect to careful in- 
terpretation and evaluation of signifi- 
cant studies. He excludes from con- 
sideration the host of investigations 
in which learning is merely involved 
or demonstrated, restricting the re- 
view to “work in areas with estab- 
lished methodology and some theoret- 
ical orientation.’’ This means a fair- 
ly heavy concentration upon animal 
learning and human conditioning, an 
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unfortunate necessity arising from the 
state of the field and which Under- 
wood. probably deplores as much as 
anyone. Research on thinking, he 
notes, ‘“‘continues to move at an ap- 
pallingly slow pace,” although “there 
are rumblings which portend better 
things to come.”’ 

Little attention is given to ques- 
tions of over-all systematization of 
the field of learning, either by way of 
introductory orientation or in the 
main body of the review. Perhaps 
conceptual cross references and inte- 
gration are not possible for most of 
these presently somewhat discrete 
problems, but continuing attention 
should perhaps be given to these 
desiderata on the part of reviewers in 
the Annual Review and in similar 
publications. 

Sensory processes. Vernon’s review 
of visual literature is the only one of 
the three chapters on the “senses”’ 
which presents an organizing frame- 
work for the literature to be reviewed. 
Licklider for hearing and Ruch for 
somesthetic and chemical senses get 
under way merely with brief indica- 
tions of what their respective re- 
views will emphasize. Once past the 
introduction, however, Vernon con- 
tents herself pretty much with de- 
scriptive reporting of a wide range of 
literature (extending from simple 
threshold phenomena to the “New 
Look” studies of motivational fac- 
tors in perception). Licklider, on the 
other hand, writes a highly lucid 
interpretative evaluation of the audi- 
tory literature. It appears to an 
outsider to be a balanced account of 
the entire spectrum of research in 
this field, insofar as a single year’s 
output yields such a product. Ruch’s 
chapter is restricted almost entirely 
to research on physiological mecha- 
nisms underlying somesthesis, with 
only about three pages on the ‘‘chemi- 
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cal senses.”’ It is a well-written re- 
view, somewhat better in respect of 
interpretation than of evaluation. 

Comparative and physiological psy- 
chology. Hess remarks about com- 
parative psychology that it is ‘‘prob- 
ably high time we stop deploring the 
lack of an orienting theoretical ap- 
proach.”’ He finds one in the work of 
European investigators, particularly 
Tinbergen and Lorenz. With this 
general orientation he proceeds to 
give a good account of a relatively 
small number of studies. Other com- 
parative psychologists, notably 
Schneirla, will probably disagree with 
Hess’s view that this recent Euro- 
pean work is the needed “‘shot in the 
arm” for their somewhat neglected 
field. 

Neff doesn’t discuss the systematic 
status of physiological psychology, 
although he commences his review 
with two brief paragraphs which 
mention the problems of major cur- 
rent interest to the specialist in this 
field. He then proceeds to a descrip- 
tive digest of studies classified under 
these headings: sensory discrimina- 
tion, basic drives, emotion, learning- 
memory-problem solving, biochemi- 
cal and neuroanatomical changes in 
mental disease. There is almost no 
interpretation or evaluation. 

Differential psychology and person- 
ality. Four chapters fall under these 
general headings: individual differ- 
ences (Anastasi), personality (Bron- 
fenbrenner), abnormalities of be- 
havior (White), special disabilities 
(Cobb). All four fields are concerned 
with psychological differences among 
individuals and classes of individuals. 

Anastasi stays within the psycho- 
metric framework in writing a well- 
organized review of the work on indi- 
vidual differences. The discussion is 
rather more on the interpretative 
than the evaluative side, except in 
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the parts concerned with the biologi- 
cal and social determinants of these 
differences. There she is critical of 
“hereditarian” inferences from in- 
adequately designed research. 

Bronfenbrenner’s chapter is well 
written and it ranks high in the 
dimension of “interpretation-evalua- 
tion.” His introductory section 
states clearly his ‘‘biases’’ and his 
justification for them. Recognizing 
that ‘“‘the attempt to deal... with 
multiple, interacting relationships 
rather than simple static entities of- 
ten leaves the theoretician with a sys- 
tem of ambiguous abstractions,’ he 
prefers the opportunities of the for- 
mer to the narrow constraints of the 
latter approach. 

White’s chapter on abnormalities 
of behavior has a far more pro- 
nounced psychodynamic orientation 
than its predecessor by Zubin in 
Vol. 3. The latter stressed organic 
and genetic factors in his selection 
of references and in his. general 
evaluative framework. White in- 
cludes such material—in particular 
a good discussion of biochemical in- 
vestigations of schizophrenia—but he 
emphasizes the influence of learning 
and life history upon abnormal be- 
havior. He concludes with the hope 
that ‘if we can arrive at more basic 
biological reaction patterns and also 
at more basic psychological reaction 
patterns these two classes of events 
will prove at last to be truly con- 
vergent.”’ In terms of its technical 


characteristics as a review, this chap- 
ter is one of the best in the book. 
Cobb defines a “‘special disability”’ 
as any defect or disability that may 
occur in an otherwise normally func- 


tioning person. Her bibliography is 
comparatively long, but its utility for 
readers is greatly reduced because it 
is not in alphabetical order. The 
material reviewed is a mixture of 
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basic and applied research on the 
etiology and_ psychological char- 
acteristics of visual, auditory, and 
speech defects, together with publica- 
tions on treatment and_ rehabilita- 
tion. The chapter is well written and 
is in general an excellent survey of a 
field not widely known to most psy- 
chologists. 

Social psychology. Newcomb opens 
his review with an interesting in- 
novation. By way of appraising 
efforts to define social psychology, he 
makes a comparative analysis of the 
content of six recent textbooks. His 
conclusion is that “social interaction” 
is the distinctive subject matter of 
social psychology, “that the term 
stands for something which can be 
studied at its own level.” The phe- 
nomena of social interaction cannot 
be explained, he thinks, by ‘mere 
extrapolation of general psychological 
principles.” 

Newcomb organizes his material 
under two main headings: attitudes 


and the processes of interaction and 
communication—without 


discussing 
the systematic  interrelationships 
among the problems and concepts of 
the two areas. The presentations of 
research findings are exceptionally 
good, although there is less critical 
evaluation than in Smith’s chapter in 
Vol. 3. 

Clinical psychology and counseling. 
Rotter sees the situation in psycho- 
diagnosis much as Magaret did in 
the preceding volume: ‘“‘experimental 
investigation of test validity empha- 
sizes more and more the absence or 
inefficiency of prediction.” His re- 
view is well planned, and probably 
has as much structural unity as a 
good theoretical orientation can give 
to an appraisal of work on a multi- 
tude of incommensurable tests. There 
are three broad headings: (a) general 
contributions to the methodology and 
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theory of personality measurement; 
(b) clinical instruments; (c) research 
instruments. There is a good sum- 
mary at the end called “Analysis of 
Trends.”’ Reviewers in other fields 
would do well to emulate this feature. 

Sanford’s account of psychother- 
apy is not as systematic or compre- 
hensive as Raimy’s chapter in Vol. 
3, although the chapter as a whole 
is a balanced interpretative appraisal 
in which clinical and scientific values 
are happily blended. A good report 
is given of the work in group therapy 
at the Tavistock Clinic in London, 
based upon personal observations 
over a period of several months. The 
longest section in the review is de- 
voted to research on psychotherapy, 
which Sanford regards as a fruitful 
means to the general investigation of 
personality. 

Williamson classifies the literature 
on counseling into (a) publications 
oriented towards psychotherapeutic 
theory and techniques, and (6) those 
focused upon ‘‘the choosing of oc- 
cupational goals based upon the diag- 
nosis of aptitudes and interests.’’ He 
hasn’t much to say about therapeutic 
studies, devoting most of the review 
to investigations of various diagnostic 
instruments. ‘There is very little 
interpretation or evaluation. 

Educational and industrial psychol- 
ogy. Superficially dissimilar, these 
two fields have many points of meth- 
odological and technological resem- 
blance. Both involvea broad range of 
psychological principles and practices 
designed to improve the effectiveness 
of fundamental social functions. Both 
draw upon all levels of psychological 
science—general, individual, and so- 
cial. Perhaps for this reason, neither 
represents a unified scientific-tech- 
nological speciality—as the two chap- 
ters in Vol. 4 will attest. 

For Carter, educational psychol- 
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ogy deals with school learning.and its 
correlates. His review begins with a 
brief outline of the problems and 
conditions which further define the 
field. Such topics as readiness for 
learning, acquisition of desirable at- 
titudes, meaningful learning, socio- 
logical correlates of learning, emotion- 
al factors in learning, and measure- 
ment problems predominate. Very 
little work on the learning of specific 
school subjects per se is reported. 
And there is almost no relationship 
between this literature and that re- 
viewed by Underwood for the general 
psychology of learning. On the whole, 
this review is a good one, in marked 
contrast to that of Elmgren in Vol. 3. 

The lack of evaluation in the re- 
views of industrial psychology has 
already heen noted. Harrell does, 
however, present a fairly extensive 
introduction in which over-all trends 
are effectively discussed. Major em- 
phasis in the body of the review goes 
to studies of human relations in in- 
dustry. 
appear to be inconclusive because of 


As a rule these field studies 


such factors as inadequate samples, 
uncontrolled conditions, and uncer- 
tain criteria. 

Statistical theory and research de- 
sign. Mosteller’s chapter is consider- 


ably longer than its predecessors in 
earlier volumes, partly because it 
covers a wider range of topics. Spe- 
cial features of the review are discus- 
sions of nonparametric statistics and 
ranking methods, which are being 
used increasingly by 
whose data often fail to satisfy the 


psychologists 


assumptions of the more conventional 
parametric methods of 
There informative in 
which studies dealing with the effects 
upon the common parametric statis- 
tics of departure from assumptions 
are reviewed. The general conclusion 
is ‘that departures from assumptions 


analysis. 


is an section 
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may have little effect at some points 
of the distribution function, say near 
the mean or median, but far out in 
the tails of the distribution errors get 
to be large and the model may just 
no longer be appropriate.’”” He sug- 
gests that it would be useful to have 
empirical studies of the effect of 
violating the assumptions to varying 
degrees on this model. His attitude 
not unusual in mathematical statisti- 
cians of empirical bent—seems to be 
that while illicit inferences are to be 
avoided, unnecessary scrapping of 
information is likewise to be mini- 
mized. Questions of the utility and 
limitations of various other mathe- 
matical ‘‘models’’ are discussed in a 
special section, including efforts to 
develop probability models for learn- 
ing data, uses of information theory, 
and difficulties in finding a suitable 
model for accident proneness. 
Theoretical psychology. ‘This is 
Bergmann’s term for the logic of 
psychology. Asa branch of the phi- 
losophy of science, theoretical psy- 
chology in this sense is concerned with 
the nature and structure of psycho- 
concepts, with the laws in 
which they occur, and the theories 
into which these laws combine. Fol- 
lowing this definition of the field, the 
author outlines the essential tenets of 
a “philosophy of psychology’’ on 
which he thinks virtual agreement 
has been reached, and devotes the 
remainder of the chapter to a critical 
analysis of deviations from tl.ese pre- 
cepts First, certain dissents from 
this position in principle are noted: 
(a) the phenomenology of Snygg and 
Combs as regards the derivation of 
concepts; (b) concerning laws, Lon- 
don's antideterminism; (c) Skinner's 
attack upon theory. After brief refu- 


logical 


2 ‘lo designate this general methodological 
position, Bergmann uses the terms “neobe- 


haviorism” or ‘logical behaviorism.” 
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tations of these attacks, Bergmann 
gets down to the main business of the 
chapter which is the ‘‘prophysiologi- 
cal’”” movement in theoretical psy- 
chology. This development has two 
foci: (a) the Meehl-MacCorquodale- 
Keigl argument for the use of hypo- 
thetical constructs as distinct. from 
intervening variables, and (b) neoges- 
taltism as represented in recent arti- 
cles by Krech. Although Bergmann’s 
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analysis may not convince his antag- 
onists, I think it is an outstanding 
contribution towards the clarification 
of the issues. It is perhaps unfortu- 
nate that he had to use so vulnerable 
a target as Krech for his attack upon 
gestaltism. But the gestaltists are 
mainly to blame; very few of them 
have ventured into the realm of for- 
mal methodological argument. 
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SHAFFER, G. WILSON, & LAZARUS, 
RICHARD S. Fundamental concepts 
in clinical psychology. New York: 
McGraw-Hill, 1952. Pp. xi+540. 
$6.00. 


This book could well have been two 
separate publications. ‘The authors 
have divided their efforts so that one 
half the chapters are written by one 
and the remainder by the other. 
There is not much similarity in ap- 
proach or in style between the two 
sections. ‘The first eight chapters are 
a sort of annotated bibliography 
covering the clinical field. The cover- 
age is quite broad but not especially 
deep. The last seven chapters are 
largely devoted to psychotherapy and 
related topics. 

The book should be useful in a 
number of ways, one of which will be 
as an aid to students preparing for 
comprehensive examinations. It in- 
cludes a great deal of information and 
it direc.s students to other excellent 
sources. 

It does not, however, live up to the 
promise of its title. Probably a 
representative group of clinical psy- 
chologists could not agree completely 
about which concepts in the field are 
really fundamental. But it is likely 
that most of them would agree that 
concepts such as psychological deter- 
minism, frustration-aggression, func- 


tional autonomy, dynamic mecha- 
nisms, and partial reinforcement, to 
name a few, are central to the field. 
None of these is given more than 
cursory attention. Although psy- 
choanalysis is discussed briefly in 
two different sections, the ego mecha- 
nisms are not included. The kindest 


thing to be said for the discussion of 
the Oedipus complex is that it is in- 
adequate. 

The book is written in the first per- 


son plural. The editorializing, which 
appears frequently, will be annoying 
to some readers and stimulating to 
others. The authors often criticize 
other clinicians for careless valida- 
tion, slipshod methodology, and 
cloudy thinking. On the other hand, 
many readers are likely to take ex- 
ception to their undocumented state- 
ments about the therapeutic process. 
In discussing therapy the authors 
stress the importance of such things 
as self-knowledge on the part of the 
therapist, the mastery of a variety 
of techniques, and special forms of 
therapeutic training. Such state- 
ments as “insight or uncovering 
therapy is, of course, the preferred 
treatment for most adjustive diffi- 
culties,’ or ‘‘reassurance is neces- 
sary in all therapeutic situations,” 
or “the patient must uncover re- 
pressed material’ will strike some 
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readers as dogmatic and unsupported 
by firm data. 

It is likely that there would be 
no general agreement among clini- 
cians that a book dealing with funda- 
mental concepts in the field should 
include five chapters on psychothera- 
py. There would probably be fewer 
votes for the necessity of a chapter 
on physical and chemical therapies. 
The latter chapter is quite detailed 
down to citing dosage of Mitragol and 
methods of applying electrodes. Much 
material in the earlier chapters is 
abbreviated or omitted on the plea 
of space limitation. Judgments will 
differ on questions of what should 
have been included and what left 
out. Many will feel that the book 
overemphasizes therapy at the ex- 
pense of other concepts. 

One final objection will occur to 


some readers. The authors con- 


stantly refer to persons with be- 
havior disorders or adjustive diffi- 


4é 


culties as “‘patients’’ who ‘‘suffer’’ 
from “‘illnesses.’’ This seems to im- 
ply a fundamental concept about the 
nature of the clinician’s problem 
which should be further examined. 
Thinking about problems is frequent- 
ly affected by the words used in their 
definition, and many psychologists 
feel strongly that by calling people 
with emotional difficulties “sick"’ 
there are created unnecessary seman- 
tic barriers to effective action. 

In a work that tries to cover as 
much ground as this one it is easy 
to find faults and to disagree with 
the authors’ choices of material for 
inclusion. The authors have made 
a real attempt to cover the field. 
Readers’ estimates of the success of 
the effort will vary with their agree- 
ment with the writers’ 
topics emphasized. 

GEORGE W. ALBEF. 

University of Helsinki. 
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KLEIN, MELANIE, HEIMANN, PAULA, 
Isaacs, Susan, & RIVIERE, JOAN. 
(Eds.) Developments in psycho- 
analysts. London: Hogarth Press 
and Institute of Psycho-analysis, 
1952. Pp. viiit+368. 30s. 

The psychoanalytic dictum that 
early infancy is the crucial develop- 
mental period has been a source of 
as much frustration as stimulation 
among psychologists. While no psy- 
chologist these days seriously ques- 
tions the importance of this early 
period, neither is any psychologist 
particularly satisfied with the evi- 
dence for its importance or the meth- 
ods for its study. The retrospective 
reconstruction of infancy through 
adult analyses, and the description 
of babies’ feelings and attitudes by 
way of adult empathy, have always 
left psychologists dissatisfied and im- 
patient. On the other hand, there 
are no conventional, generally ac- 
cepted psychological methods for 
interpreting the emotional signifi- 
cance of infant behavior. Conse- 
quently, there are many _ theories, 
little data, and deep frustrations. 

The present collection of papers, in 
adding much to theory and little to 
data, may strain the frustration 
tolerance of the psychological reader. 
For the most part, the book aims to 
clarify Melanie Klein’s theoretical 
position concerning early infancy. As 
usual, her contributions are imagina- 
tive, provocative, and controversial. 
A fair evaluation of the writings, how- 
ever, requires criticism on two dif- 
ferent levels. 

One may begin by considering the 
theoretical contributions alone. Here 
there is little question that real ad- 
vance has been made in the sharpen- 
ing and extension of Klein’s concepts 
beyond the position she maintained 
in The Psychoanalysis of Children 
(1932). The emphasis on Freud’s 
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concept of death instinct, and its 
use as the source of basic infantile 
anxiety, provides a starting point for 
the first of two phases of infant de- 
velopment: the  paranoid-schizoid 
position. A major defense during this 
early period is splitting—basically 
the splitting between the ‘‘good"’ and 
“bad” breast, but reflecting as well 
a splitting or nonintegration of the 
ego. It is only as the ego becomes able 
to sustain anxiety that the infant can 
adopt the more mature depressive 
position, which itself fosters defenses 
leading to greater ego integration. 
The relationship of this developmen- 
tal sequence (greatly oversimplified 
by the reviewer) to the growth of 
introjection and projection represents 
a major contribution to psychoana- 
lytic theory. 

Not everybody will agree with this 
expansion of theory. Many of the 
points made by Klein have been for 
years a source of controversy be- 


tween one English analytic group and 


certain European analysts. ‘Too of- 
ten, this controversy has ended with 
mild name-calling: who is the ‘“‘genu- 
ine’ psychoanalyst and who the im- 
postor? Frequently enough, it has 
involved real questions as to the ap- 
propriateness of an extension of cer- 
tain Freudian concepts to the earliest 
months of life. 

One cannot really evaluate theoret- 
ical contributions alone, however. 
Internal consistency is never enough. 
The more closely and carefully the 
detailed accounts of postulated in- 
fant development are written, the 
more they cry for empirical test. The 
test is not to be found in these papers, 
although a suggestion as to Klein's 
methods of arriving at hypotheses is. 
The instances which confirm Klein's 
hypotheses, as reported in one chap- 
ter, are taken from published British 
studies of infant development, from 
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her own clinical observations, and 
from casual, sometimes secondhand 
accounts of what babies do. As 
always, Melanie Klein in her observa- 
tions is the sensitive, intuitive investi- 
gator from whom few meanings of 
infant behavior are hidden. Riviere 
and Isaacs add notably to her ac- 
counts. But there is no consideration 
of alternative hypotheses, no account 
of the negative case, no hint as to 
the path from observed behavior to 
intuitive interpretation to theory con- 
struction. 

Even in the absence of these requi- 
sites of scientific method, the psy- 
chologist might be satisfied if the 
hypotheses advanced were testable. 
A careful survey of Klein’s notions 
suggests that some probably are sub- 
ject to test, although these are the 
peripheral rather than the crucial 
hypotheses. If one cannot study the 
content of the unconscious fantasy 
of a three-month-old infant, for exam- 
ple, one still may be able to vary the 
frustration to which he is subjected 
and observe the typical defenses. If 
one cannot be sure of the infant’s at- 
titude toward the breast as_part- 
object, one may still examine the 
relative need-satisfying properties of 
food and attention. Although one 
may not yet be able to relate weaning 
to persecutory anxiety in the infant’s 
thoughts, one may nevertheless look 
to the spontaneous play of weaned 
infants as an index of the significance 
of lost objects to the child. 

It is an encouraging sign that nu- 
merous isolated articles in the litera- 
ture of child development touch upon 
just such points as these. Today their 
number is increasing. Indeed, much 
of Klein’s theorizing sounds less 
bizarre now than it did in 1932, large- 
ly because we are gradually accumu- 
lating from infants observational 
material which has been ordered in 
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psychoanalytic terms. The lasting 
importance of these papers may well 
lie not so much in the theoretical 
controversies they foster as in the 
direction they give to the systematic 
observation of infants. 
ANN MAGARET GARNER. 
University of Illinois, 
College of Medicine. 


Measurements 
(Rev. Ed.) 


Press, 1952. 


GREENE, EDWARD B. 
of human behavior. 
New York: Odyssey 
Pp. xxiv+790. $4.75. 

Readers familiar with the first edi- 
tion of this book will be prepared for 
the comprehensive scope of the re- 
vision and its vast compilation of de- 
tailed and up-to-date 
about 


information 


measuring techniques of all 
varieties. They will be disappointed, 
however, in their expectations of a 
more tightly integrated book with a 
clearer and more precise exposition of 
basic principles and concepts of psy- 


chological measurement. 

The fault may lie in the nature of 
the task the author set for himself. 
What was difficult in 1941 has become 
virtually impossible a decade later. 
Measurement and evaluation devices 
have proliferated rapidly in all areas 
of psychology and the development of 
their systematic rationale has not 
kept pace with empirical applications. 
Any book which attempts to encom- 
pass practically all the techniques 
(and little of the underlying theory) 
which have been or are employed in 
quantifying and assessing human be- 
havior must suffer from some super- 
ficiality and lack of coherence. And 
the range covered in this one is for- 
midable: from psychophysical meth- 
ods to the Szondi test, from Thur- 
stone’s attitude scaling to OSS evalu- 
ation procedures and Kinsey’s inter- 
viewing methods. Unfortunately, the 
book is also exasperatingly crammed 
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with minutiae, often irrelevant. Even 
the subjects who posed for the photo- 
graphs of test administrations are 
graciously identified by name. 

The introductory chapters provide 
only a weak foundation for support- 
ing this mass of material. For exam- 
ple, the problem of the nature of 
measurement is dispatched in a para- 
graph; the procedures for developing 
measuring instruments are given in 
the form of brief exhortations such 
as the following: ‘‘decide specifically 
what is to be measured and how;.. . 
secure a large number of sample 
items..."; or, ‘analyze the re- 
sponses to each item to determine 
such attributes as content... .’’ The 
other introductory chapters deal with 
test nomenclature (in which a curious 
distinction is made between achieve- 
ment, aptitude, and psychological [!] 
tests) and the characteristics of a 
“good instrument.”’ Apart from a 
cursory discussion of _ reliability, 
norms, and the questionable attribute 
of test ‘‘uniqueness,” the author 
never develops the general method- 
ological considerations essential to an 
understanding of test construction 
and accurate interpretation of test 
results. Such questions as the extent 
to which psychological tests satisfy 
the criteria for measurement, the 
logic underlying the concepts and 
empirical determination of test reli- 
ability and validity, the selection of 
the standardization group, etc. are 
disregarded or only incidentally 
treated. Nor are the concepts and 
procedures included in the three chap- 
ters on ‘“‘elementary statistics’? (one 
of which deals with factorial analysis) 
effectively applied to the problems 
involved in evaluating and using 
tests. In this connection, it is regret- 
table that the chapters in the earlier 
edition on “persistent problems”’ 
were deleted. 
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The remaining 500-odd pages are 
devoted primarily to a description of 
specific tests and related tools. There 
are seven chapters concerned with 
tests for early childhood, individual 
tests of ability, group tests of ability, 
motor and mechanical tests, tests of 
special aptitude, educational achieve- 
ment tests, and those developed for 
military personnel in World War II. 
In each of these chapters, representa- 
tive tests are and _illus- 
trated, scoring techniques explained, 
and some of the research findings on 
the use of the test surveyed. Many 
new and valuable tests developed 
since the appearance of the first 
edition have been included. There 
are, however, a few surprising omis- 
sions like the WISC and the Merrill- 
Palmer whereas some comparatively 
ancient tests of limited value have 
been retained. 

The chapters on attitude-, interest-, 
and personality-measurement have 
been greatly expanded. They are 
preceded by a distressing introduc- 
tion to dynamic theory and _ struc- 
ture of personality. The need for 


described 


such a chapter is clear since many 


projective tests are discussed. But 
the oversimplified and, in_ places, 
muddled account points up the un- 
realistic design of the book. Clinical 
tests like the Bender-Gestalt, TAT, 
Rorschach, and Draw-a-Person are 
described, for example, quite fully. 
Such material, however, cannot serve 
in lieu of training manuals, nor is the 
methodology sufficiently explored to 
give the reader insight into the com- 
plex problems related to the valida- 
tion as well as the clinical and research 
use of these tools. 

Some errors of fact and naiveté are 
understandable in a survey text of 
this scope. Still, inaccuracies like the 
following are too frequent: ‘‘the word 
trait...is used to refer to any 
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physical aspect of a person... or to 
any mental aspect such as speed of 
reading... ’’; “thesum of the verbal 
test scores [on the W-B] yields a 
verbal MA... ”’; “‘this [the standard 
deviation] provides a method of scal- 
ing scores ...comparable with the 
best physical scales...” ; ‘‘the K 
score [on the MMPI] is the number 
of answers omitted because the client 
cannot say or will not choose.”’ 

The breadth of content combined 
with the unsystematic approach lim- 
its the audience for the book. It can 
probably best serve as a reference 
text for advanced students who wish 
to become acquainted with a wider 
variety of tests than the standard 
laboratory and practicum courses are 
able to cover. The profusion of visual 
illustrations, the research bibliogra- 
phies, and the fairly complete classi- 
fied lists of available tests and in- 
ventories should be particularly help- 
ful for this purpose. 

EVELYN RASKIN. 

Brooklyn College. 


BAUMGARTEN, FRANZISKA. (Ed.) La 
psychotechnique dans le monde mo- 
derne. (Psychotechnics in the mod- 
ern world.) Paris: Presses Uni- 
versitaires de France, 1952. Pp. 
xi+630. 2,000 fr. 


Appropriately, these Proceedings 
of the Ninth International Congress 
of Applied Psychology were published 
in the series Bibliothéque Scientifique 
Internationale (Sciences Humaines, 
Section Psychologie, with H. Piéron 
as the chief editor), designed princi- 
pally as means for acquainting the 
French-speaking psychologists with 
important developments in the field 
of scientific psychology. In this series 
were published the translations of 
Rorschach’s Psychodiagnostics (to- 
gether with the Béchner-Halpern vol- 
ume on clinical applications of the 
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Rorschach test); G. H. Thomson's 
treatise on factorial analysis of human 
ability; and H. J. Eysenck’s work on 
the dimensions of personality; and a 
large number of books by American 
authors (W. H. Sheldon’s Varieties 
of Human Physique, two volumes by 
A. Gesell and F. Ilg, C. Wolff's 
Human Hand, as well as R. S. Wood- 
worth’s Experimental Psychology, 
C. T. Morgan’s Physiological Psychol- 
ogy, and D. Krech and R. S. Crutch- 
field’s Social Psychology). Among the 
few volumes by French authors are 
J. M. Faverage’s book on statistical 
methods and a book on early child de- 
velopment by O. Brunet and I. 
Lezine. 

There has been an interval of a 
long, eventful 15 years between the 
Kighth Congress of the International 
Psychotechnical Association (Prague, 
1934) and the Ninth Congress (Bern, 
1949). The editor stressed in her In- 
troduction that the 


Congress has 


offered to the participants an oppor- 
tunity to become acquainted with the 
present, dramatically altered features 
of psychotechnology. 

To provide a historical perspective, 


Dr. Baumgarten, as the 
general of the Association, requested 
reports on developments in the field 
of applied psychology in different 
countries during the war years. The 
communications were published un- 
der the title Progress of Psychotech- 
nics (1939-1945) by A. Francke in 
Bern. The continued interference of 
political ideologies with the handi- 


secretary 


work of the applied psychologist is 
reflected in the fact that the Polish 
delegation, in a letter of May 5, 1950, 
withdrew the manuscripts of papers 
prepared for the Congress, which they 
were unable to attend. 

It appears as a wise policy that the 
Proceedings have not been limited to 
abstracts of the papers nor do they 
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reflect with photographic accuracy 
what has transpired. The papers 
have been frequently shortened and 
regrouped. Among the outstanding 
recent trends in psychotechnology, 
Dr. Baumgarten noted the concern 
with social problems (including hu- 
man relations in industry) and the 
search for tests of personality. 
Joser BRoZEK. 
University of Minnesota. 


AWSHE, C. H. (Ed.) 
industrial relations. 
MeGraw-Hill, 1953. 
$5.50. 


Psychology of 
New York: 
Pp. vii+ 350. 


The stated purpose of this book is 
“to present in a reasonably concise 
and non-technical form some of the 
content of industrial psychology 
. might be useful to people 
work with or manage other 
people.’ The reader will find that the 
authors have been very successful 
in fulfilling this purpose. New ma- 
terial is presented in a style readily 
understandable by the supervisory 
force and by other management per- 
sonnel. An exhaustive list of refer- 
the end of each chapter 
makes it possible for the reader to 
investigate any topic in greater de- 
tail. 

The rigorous scientific approach 
to problems typical of the Purdue 
group isevident throughout the book, 
and the application of the experi- 
mental method to industrial rela- 
tions is documented with practical 


which. . 
who 


ences at 


examples. 

One example of the critical atti- 
tude the authors in 
evaluating the studies cited can he 


exercised by 


seen in the chapter on employee su- 
pervision, in which the results of a 
nationwide survey of foremen are 
The original article indi- 
cated that many of the foremen felt 
they were not posted on company 


reported. 
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policies and that union shop stewards 
and others had usurped some of their 
rights. The authors of this book 
point out that their conclusions can- 
not be justified by the basic data and 
that only a minority of foremen held 
these unfavorable views. 

Three chapters of the book are de- 
voted to employee and group rela- 
tions. These chapters are outstand- 
ing and should prove most helpful to 
management personnel. 
sion of the informal group in the 
work force will enable foremen to 
understand the reasons for its’ exist- 
ence. When the supervisors realize 
that the informal group insures the 
individual personal recognition in a 
highly impersonal system and sup- 
plements the formal organization 
structure they will be better able to 
carry out their duties. 

Naturally, no book contains all the 
material the reader thinks should be 
included since there are practical 
limits of size which must be observed. 
Throughout this book a few chapters 
would have been strengthened by 
the addition of new material or a 
more thorough discussion of the ma- 
terial presented. The chapter on 
motivation and discontent in indus- 
try is somewhat oversimplified even 
for the nonpsychological reader. 

It is implied that the industrial 
psychologist is able to determine the 
motivation for an employee's behav- 
ior by examining the work and home 
environment. If the: reader is not 
aware of the effort required and the 
limitations of the present state of the 
art, he may well expect overnight 
changes in the work force and sub- 
sequently be disappointed when they 
do not occur. 

In the chapter on employee coun- 
seling it is suggested that in some 
organizations the first-line supervisor 
will have to double as employee 
counselor. This is undoubtedly true, 


The discus- 
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but not enough attention is devoted 
to the fact that it would be a difficult 
task for the supervisor to function in 
this dual capacity. The supposition 
that the supervisor can set aside his 
interests and activities for the time 
he acts as the employee counselor is 
questionable. 

Unfortunately, a major failing of 
this book is the fact that the authors 
ignored union-management relations 
under the Taft-Hartley Act. The pro- 
vision for an enforced ‘‘cooling off’ 
period under this Act has very defi- 
nite implications for industrial rela- 
tions. The worker, the union shop 
steward, and the foreman must try to 
“carry on’ as usual during a period 
when negotiations would have 
reached a climax under other condi- 
tions. Worker-foreman relationships 
should also have been considered in 
the prestrike and poststrike periods. 

This book represents an effort to 
fill a gap where no adequate literature 
previously existed. It will be very 
helpful to supervisory personnel and 
will enable many people who do not 
have specialized training in this area 
to understand and use industrial 
It is fur- 


psychological techniques. 
ther suggested that this book would 
prove valuable as a second text in 
management training courses. 
Josern W. WISSEL. 
Dunlap and Associates, Inc. 


POWDERMAKER, FLORENCE B., & 
FRANK, JEROME D. Group psycho- 
therapy: studies in methodology of 
research and therapy. Cambridge: 
Harvard Univer., Press, 1953. Pp. 
xv+615. $6.50. 


The meat of this book lies in the 
numerous detailed descriptions of crit- 
ical events arising in an extensive 
series of group therapy sessions with 
neurotic and schizophrenic veterans, 
events which have been maturely 
reflected upon and used as a basis for 
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helpful generalizations about the 
process and technique of group thera- 
py. The authors and their collabora- 
tors are sensitive observers, conscien- 
tious reporters, and sensible commen- 
tators. The trimmings of the book 
lie in the research data reported, 
which are nice to have but not nearly 
so nourishing as the analyses of group 
meetings and the 
mentaries thereon. 


excellent com- 

The report is based on a group ef- 
fort lasting over a period of two 
years. Some 120 neurotic patients of 
a mental hygiene clinic and some 170 
chronic schizophrenics in a_ psychi- 
atric hospital were treated by 19 
different psychiatrists working with 
a total of 27 groups. A research team 
of eleven persons, including psychia- 
trists, psychologists, and social work- 
ers, observed and recorded the meet- 
ings and then worked together to 
make communicable sense of the re 
sults of their experiences. An average 
of five patients attended the clinic 
groups. The groups of psychotics 
were more than 
circumstance reported as_ favoring 
therapy with these severely disturbed 
people. One group, and a fascinating 
one, was the entire population of a 
ward, about 85 patients. Most of 
the therapists were inexperienced in 
working with groups at the start of 
the project, and though they seem to 
share confidence in catharsis and in- 


twice as large, a 


terpretation as sources of gain in 
therapy, their newness to the group 
situation ensured considerable vari- 
ability in approach. Groups varied 
in size and in rationale of composi- 
tion; some groups were open, others 
were closed; duration of therapy 
varied from 8 to 175 meetings. In 
the neurotic group most patients re- 
individual 
Such sources of variability 


ceived 
rently. 


therapy concur- 


are splendid for generating hypothe- 
ses but impose tangible limitations 
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on their verification. An observer 
sat with each group and was responsi- 
ble in collaboration with the thera- 
pist for recording what went on. 
Tape recorders were used as an aid to 
accuracy but not as a source of ver- 
batim transcripts. The accounts of 
sessions and of critical events were 
made more graphic and complete by 
descriptions of postures, facial ex- 
pressions, and side plays, and more 
pointed by the omission of material 
irrelevant. But at the 
same time, students of therapy who 
have come to find verbatim tran- 
scripts indispensable will find them— 
indispensable. 

weak research-wise, the 
book is packed, 600 pages full, with 
discerning observations about the dy- 
namics of interpersonal relationships 
in therapy and with good, practical 
suggestions for making group therapy 
work. At this stage of our knowledge 
of group therapy, the problem is not 
so much to validate its effectiveness, 
which the authors essayed with 
limited success, as it is to define the 


considered 


Though 


process and to describe rigorously 
just what goes on. This latter need 
meets admirably, for one 
approach to therapy and for a par- 
ticular population. it will have much 
immediate value for therapists and 
will be a rich source of hypotheses for 
more circumscribed and definitive 


the book 


studies. 
NICHOLAS Hosss. 
Peabody College. 


GELLHORN, ERNST. Physiological 
foundations of neurology and psy- 
chiatry. Minneapolis: Univer. of 
Minnesota Press, 1953. 
+556. $8.50. 


Pp. xiii 


With the rediscovery of Freud and 
psychoanalysis during the thirties by 


organized American psychiatry, pop- 
ular interest swung away from the 
organic etiology of mental disorder 
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and tended to concentrate itself upon 
““dynamic,”’ developmental concepts 
and explanations. This break with 
tradition was a healthy one, but as is 
so often the unfortunate consequent 
of such extreme pendular movements 
within a discipline, there was not 
only an overemphasis upon func- 
tional factors, but a real neglect and 
almost a degradation of the physi- 
ological approach. It has seemed to 
this reviewer, however, that the last 
few years have seen the beginnings 
of a corrective movement with the 
pendulum swinging back toward in- 
terest in the physiological, and some 
hope for a more healthy balance be- 
tween functional and organic influ- 
ences in our study and interpretation 
of psychopathosis. 

Professor Gellhorn’s book is there- 
fore a very timely one. Its explicit 
purpose is to survey and evaluate the 
links which can be established be- 
tween experimental neurophysiology 


and clinical neurology and psychia- 


try. It begins with a survey of the 
basic factors regulating neuronal ac- 
tivity, proceeds through a discussion 
of the physiology and pathology of 
movement, the physiology of con- 
sciousness, and the physiology and 
pharmacology of the autonomic nerv- 
ous system to a series of stimulating 
and provocative integrative chapters 
on neuro-endocrine action, the physi- 
ological basis of emotion, condition- 
ing, homeostasis, and the phenomena 
of “constancy.”’ The closing section 
on applications, relates the material 
to the clinical problems of the psy- 
choses and psychoneuroses, and shock 
and carbon dioxide therapy. 

This is admittedly a huge canvas, 
and no single author could be ex- 
pected to do the picture complete 
justice. ‘“‘Justice,”” however, is a 
relative term, and in this reviewer's 
opinion, Gellhorn has done an ex- 
cellent job. There are some omis- 
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sions, and it is obvious that Gellhorn 
writes with greater detail and greater 
enthusiasm where his own experi- 
mental work is concerned. He has 
not hesitated to take sides on con- 
troversial issues and occasionally he 
has made specific suggestions for 
treatment. This is illustrated by the 
chapter on the restitution of move- 
ment after central lesions where he 
pummels the general concept of the 
‘“plasticity’’ of neural function, and 
offers suggested lines to be followed 
in re-education. The net result of his 
partisan attitude, however, does not 
interfere with the fairness or scope 
of his survey, and does add a flavor 
and a definite liveliness to his treat- 
ment. Considering the difficulty of 
the subject, the book is well written 
and reads relatively easily. Gellhorn 
has succeeded in his goal of demon- 
strating ‘‘the fruitfulness of the physi- 
ological method for the study of 
pathological phenomena and the re- 
wards for physiology itself of this 
type of research.” 

kor psychologists the book is time- 
ly and important. In an age which 
is marked by its absorption in func- 
tional explanatory concepts, a devo- 
tion to higher order statistical ab- 
stractions, and a resulting tendency 
to intellectualize and verbalize the 
problems of human behavior, Gell- 
horn presents fundamental physi- 
ological data whose explanatory pow- 
ers and predictive potential cannot be 
neglected. The book holds both a 
promise and a warning for contem- 
porary psychology and cannot be 
overlooked. 

WILLIAM A. Hunt. 
Northwestern University. 
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For two reasons the English trans- 
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lation of this volume, first published 
in German in 1946, is something of an 
anticlimax. Most psychologists in 
this country are now generally fa- 
miliar with Szondi’s test and unusual 
theories through the work of his stu- 
dent and _ co-worker, Deri. 
Furthermore, research results on the 
Szondi Test appearing in recent years 
are generally unfavorable. There is 
little need to touch on the test itself 
in this review despite the fact that 
the book contains the basic manual 
and, presumably, the validating evi- 
dence for the test as a psychodiag- 
nostic instrument. Borstelmann and 
W. Klopfer’s excellent review and 
critical evaluation of the research on 
the test appeared in the March 1953 
issue of this journal. Although Susan 
Deri claims that the test is not 
dependent upon the genetic theories 
of its author, Szondi apparently be- 
lieves that data obtained from the 
test results verify his theories. 

Diagnostics of 
Drives Szondi presents a_ highly 
speculative theory of personality 
which, he states, is derived from a 
union of genetics and depth psychol- 
ogy (psychoanalysis) validated by 
the results of ‘‘more than 4000 ex- 
periments.”” The several thousand 
experiments evidently refer to that 
many individual administrations of 
the Szondi Test to an unreported 
number of subjects from an unspeci- 
fied sample of the “general popula- 
tion,”’ and to undescribed criterion 
groups of abnormal subjects. His 
preferred technique for citing evi- 
dence consists in anecdotal descrip- 
tions of single cases whose test pro- 
files always seem to coincide exactly 
with the principle under discussion. 
The text also contains a number of 
percentage tables, but two of these 
are labeled ‘relative frequencies (as- 
sumed),”’ and the others are related 
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in some undisclosed fashion to the 
“4000 experiments.’”” Sample N’s, 
means, and dispersions are not given. 

This book is definitely not con- 
cerned with research on motivation, 
at least as we know it. The inclusion 
of the word “experimental” in the 
title and in many chapter headings is 
misleading. Thus the reader is forced 
to assess the personality theory on 
the basis of its reasonableness and 
internal consistency. To the Ameri- 
can psychologist, the theory’s rea- 
sonableness is immediately suspect 
from Szondi’s preface which declaims 
that this “‘new approach serves as an 
independent means of psychodiag- 
nosis in the service of psychopathol- 
ogy, vocational psychology, psychol- 
ogy of delinquency, pedagogy and 
characterology.... According to 
the working hypothesis repressed 
latent genes in the lineal (inherited) 
unconscious determine the choice in 
love, friendship, profession, sickness 
and death (sic).” 

The role of 
genes in 


dominant manifest 
this psychology of pre- 
destination is not mentioned. Moti- 
vation, he claims, is based on eight 
specific drive needs (factors) derived 
as arbitrary polarities from four in- 
dependent hereditary syndromes. He 
implies that the syndromes are ac- 
cepted by geneticists interested in 
mental disorder. As there is no 
qualitative difference in motivation 
between the normal and the ab- 
normal, the drive needs must be 
universals. 

The book may contain some in- 
tuitive, basic insights into human 
personality, but, as far as can be 
judged, Szondi’s insights are largely 
Freudian constructions translated in- 
to a new and less reasonable frame- 
work. 

Victor C. Rarmy. 

University of Colorado. 
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